Stylus for use with transcription system

ABSTRACT

A stylus for use in a transcription system which includes a plurality of signal receivers for positioning adjacent a writing surface and for receiving a position signal transmitted from the stylus when the stylus is positioned adjacent the writing surface, the signal receivers producing timing signals in response to receiving the position signal from the stylus, the transcription system using the timing signals to determine a position of the stylus adjacent the writing surface, the stylus comprising: a stylus housing defining a volume for housing a writing element, an opening on a distal end of the stylus housing through which a portion of the writing element extends for writing on a writing surface, and a door on a side of the stylus housing which may be opened or removed and through which a writing element can be introduced into and removed from the stylus housing; and the position signal transmitter for transmitting the position signal.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a Continuation-in-Part of U.S. ProvisionalApplication No. 60/109,361, filed Nov. 20, 1998, U.S. ProvisionalApplication No. 60/090,744, filed Jun. 26, 1998, and U.S. applicationSer. No. 09/079,430, filed May 14, 1998, entitled Transcription System,all of which are incorporated herein by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The invention relates to a system for recording writing performed on asurface and its components and related methods where the position of astylus used in the system to write on the surface is tracked usingsignals.

2. Description of Related Art

Existing technologies for capturing and storing handwritten notesinclude digitized writing surfaces such as electronic whiteboards orSMARTBOARDS™. These electronic whiteboards typically either photocopy anentire writing surface or serve as the actual input device (e.g. anelectronic template) for capturing the handwritten data. The whiteboardsmay be active or passive electronic devices where the user writes on thesurface with a special stylus. The active devices may be touchsensitive, or responsive to a light or laser pen wherein the whiteboardis the detector that detects the active signal. The passive electronicboards tend to use large, expensive, board-sized photocopyingmechanisms.

As described above, whiteboard systems of the related art are large,cumbersome, expensive and immobile.

SUMMARY OF THE INVENTION

Various detectors for use in transcription systems according to thepresent invention are provided. In one embodiment, the detectorcomprises a signal receiver for positioning adjacent a writing surfaceand for receiving a position signal transmitted from a stylus when thestylus is positioned adjacent the writing surface, the signal receiverproducing a timing signal in response to receiving the position signal;and a signal focussing element having a reflecting surface which isshaped and oriented relative to the signal receiver to reflect theposition signal transmitted from the stylus onto the signal receiver.

In another embodiment, the detector comprises a signal receiver forpositioning adjacent a writing surface and for receiving a positionsignal transmitted from a stylus when the stylus is positioned adjacentthe writing surface, the signal receiver producing a timing signal inresponse to receiving the position signal; and a signal shieldingelement shaped and oriented relative to the signal receiver to reflectposition signals transmitted by the stylus away from the signal receiverwhen the stylus is positioned outside a predetermined region of thewriting surface.

In yet another embodiment, the detector comprises a signal receiver forpositioning adjacent a writing surface and for receiving a positionsignal transmitted from a stylus when the stylus is positioned adjacentthe writing surface, the signal receiver producing a timing signal inresponse to receiving the position signal; a signal focussing elementhaving a reflecting surface which is oriented relative to the signalreceiver to reflect the position signal transmitted from the stylus ontothe signal receiver; and a signal shielding element shaped and orientedrelative to the signal receiver to reflect position signals transmittedby the stylus away from the signal receiver when the stylus ispositioned outside a predetermined region of the writing surface.

In regard to any of the detector embodiments, the signal shieldingelement is optionally shaped and oriented relative to the signalreceiver to reflect position signals transmitted by the stylus away fromthe signal receiver when the stylus is positioned adjacent the writingsurface outside of an angular range of about 70 to 110 degrees extendingoutward from the detector parallel to the writing surface, preferablyabout 90 degrees. The signal shielding element may also be optionallyshaped and oriented relative to the signal receiver to reflect positionsignals transmitted by the stylus away from the signal receiver when thestylus is positioned adjacent the writing surface outside of an angularrange of about 160 to 200 degrees extending outward from the detectorparallel to the writing surface, preferably about 180 degrees.

In regard to any of the detector embodiments, at least a portion of thereflecting surface may have a curved shape such as a parabolic shape.The signal receiver may be positioned adjacent a focus of the parabolicshaped portion of the reflecting surface.

In regard to any of the detector embodiments, the detector may furthercomprise a mechanism for removably attaching the detector to the writingsurface.

Other embodiments of detectors which may be used in the transcriptionsystem of the present invention, and variations thereof, are describedherein and are intended to be encompassed within the scope of thepresent invention.

Various detector assemblies for use in transcription systems accordingto the present invention are also provided. In one embodiment, thedetector assembly comprises first and second signal receivers forpositioning adjacent a writing surface and for receiving a positionsignal transmitted from a stylus when the stylus is positioned adjacentthe writing surface, the first and signal receivers each producingtiming signals in response to receiving the position signal.

In another embodiment, the detector assembly comprises first and secondsignal receivers for positioning adjacent a writing surface and forreceiving a position signal transmitted from a stylus when the stylus ispositioned adjacent the writing surface, the first and signal receiverseach producing timing signals in response to receiving the positionsignal; and a member coupling the first and second signal receivers, thecoupling member being capable of adopting two or more configurationswhere a distance between the first and second signal receivers changesin at least two of the configurations.

According to this embodiment, the coupling member may be capable oftelescopic expansion and contraction. The coupling member may alsoinclude a hinge by which the signal receivers can be angularly movedrelative to each other. The coupling member may include at least twohinges. The coupling member may also include an attachment mechanism forremovably attaching the detector assembly to a writing surface. Thecoupling member may optionally hold the first and second signalreceivers a predetermined distance apart from each other when thedetector assembly adopts at least one of the configurations. Thecoupling member may also include a locking mechanism for releasiblylocking the detector assembly in at least one of the configurations. Thelocking assembly preferably holds the first and second signal receiversa predetermined distance apart from each other. The first and secondsignal receivers may be removably attachable to the coupling member.

Also according to this embodiment, the detector assembly may adopt afirst configuration where the first and second signal receivers areseparated from each other and a second configuration where the first andsecond signal receivers are positioned adjacent each other. The detectorassembly may also adopt a first configuration where the first and secondsignal receivers are a first distance apart and a second configurationwhere the first and second signal receivers are a second distance apartthat is less than 75% of the first distance, preferably less than about50% of the first distance. The detector assembly may also be capable ofadopting a first configuration having a first lateral footprint andsecond configuration having a second lateral footprint that is less than75% of the first lateral footprint, preferably a second lateralfootprint that is less than about 50% of the first lateral footprint. Inone variation, the second lateral footprint that is between about 5% and75% of the first lateral footprint.

In another embodiment, a detector assembly is provided which comprises ahousing for mounting to the writing surface; a plurality of signalreceivers; and at least one user activated control switch whoseactivation by a user when the detector assembly is mounted to thewriting surface produces a control signal which causes the transcriptionsystem to perform a function in response.

According to this embodiment, activation of one of the control switchescan cause an image displayed on a monitor operatively connected to thetranscription system to be modified. Activation of one of the controlswitches can also cause at least a portion of an image displayed on amonitor operatively connected to the transcription system to be erased,saved, printed, electronically mailed, or facsimiled. Activation of oneof the control switches can also cause a writing property associatedwith a stylus by the transcription system to be changed. Activation ofone of the control switches can also cause a color associated with astylus by the transcription system to be changed.

In regard to any of the detector assembly embodiments, the detectorassembly may further comprise a mechanism for removably attaching thedetector assembly to the writing surface. An example of such anattachment mechanism is a suction cup, preferably a cam activatedsuction cup.

In regard to any of the detector assembly embodiments, the detectorassembly may further comprise a hardware unit which receives timingsignals produced by the signal receivers, the hardware unit includinglogic for processing the timing signals to determine a time of flight ofthe position signal from the stylus to the signal receivers.

In regard to any of the detector assembly embodiments, the detectorassembly may also further comprise a rectifier connected in seriesbetween the signal receivers and the hardware unit such that thehardware unit receives the timing signal from the signal receivers viathe rectifier.

In regard to any of the detector assembly embodiments, the detectorassembly may also further comprise a comparator connected in seriesbetween the rectifier and the hardware unit such that the hardware unitreceives the timing signal from the rectifier via the comparator.

In regard to any of the detector assembly embodiments, the detectorassembly may be designed to be operated under battery power. Forexample, the detector assembly may be operated under battery power froma laptop computer. The detector assembly may also be operated underbattery power having a voltage between about 1.5 and 24 volts,preferably between about 1.5 and 12 volts.

In regard to any of the detector assembly embodiments, the detectorassembly may further include a power source for operating the detectorassembly. The power source may be a battery. The battery may have avoltage of between about 1.5 volts and 24 volts, preferably betweenabout 1.5 volts and 12 volts.

In regard to any of the detector assembly embodiments, the detectorassembly may optionally include any of the detector embodimentsdescribed above. In particular, the detector assembly may include signalfocussing elements and/or signal shielding elements.

In regard to any of the detector assembly embodiments, the detectorassembly may further include a microphone. The microphone may be used inthe transcription system to record sound information during atranscription period and may be used to receive voice commands foroperating the transcription system.

Other embodiments of detector assemblies which may be used in thetranscription system of the present invention, and variations thereof,are described herein and are intended to be encompassed within the scopeof the present invention.

Various styli for use in transcription systems according to the presentinvention are also provided.

In one embodiment, the stylus comprises a stylus housing defining avolume for housing a writing element and an opening on a distal end ofthe stylus housing through which a portion of the writing elementextends for writing on a writing surface.

In another embodiment, the stylus comprises a stylus housing defining avolume for housing a writing element, an opening on a distal end of thestylus housing through which a portion of the writing element extendsfor writing on a writing surface, and a door on a side of the stylushousing which may be opened or removed and through which a writingelement can be introduced into and removed from the stylus housing.

In another embodiment, the stylus comprises a stylus housing defining avolume for housing a writing element and an opening on a distal end ofthe stylus housing through which a portion of the writing elementextends for writing on a writing surface, the stylus housing including aremovable adapter for adjusting the volume of the housing to accommodatea particular type of writing element to be positioned within thehousing.

According to this embodiment, the particular type of writing element maybe selected from the group consisting of whiteboard marker, pen, penciland chalk. The particular type of writing element may also be a color ofwriting element or a brand of writing element. The removable adaptor maybe color coordinated with a color of the writing element.

In another embodiment, the stylus comprises a power level sensor forsensing the power level of a power source housed within the stylus; anda signal transmitter configured to transmit power signals havinginformation concerning the power level of the power source. The stylusmay further comprise logic coupled with the power level sensor formonitoring the power level and causing the power signal to betransmitted from the signal transmitter once the power level of thepower source has fallen below a predetermined level. The power levelsignal may be encoded into a position signal or a reference signal. Theposition signal may be a sonic signal.

In another embodiment, a stylus is provided which includes a positionsignal transmitter; and a stylus housing defining a volume for housing aremovable writing element which includes a power source for providingoperating power to the stylus, a portion of the volume for housing thewriting element including a power source contact area for placing thestylus in electrical contact with the writing element power source. Thestylus may optionally include a writing tip and a conduit forcommunicating writing media from the writing element to the writing tip.The stylus of this embodiment may optionally be part of a kit whichincludes a removable writing element including a writing element housingsized to fit within the volume of the stylus housing, writing mediacontained within the writing element housing, a power source forproviding operating power to the stylus, and power source contactspositioned on the writing element housing such that the power sourcecontact area is in electrical contact with the power source contactswhen the writing element is positioned within the stylus housing. Thepresent invention also relates to the writing element which includes thepower source for providing operating power to the stylus.

Further according to this embodiment, the stylus and/or the writingelement may include electronics which causes a signal to be transmittedby the stylus which identifies the stylus and/or the writing element asbeing compatible with the transcription system. In this regard, thestylus and/or the writing element may include logic for producingencoded identification signals, the transcription system also includinglogic for recognizing the encoded identification signals. Byincorporating this feature, use of styluses and writing elementsincompatible with the transcription system can be prevented by thesystem.

According to any of the stylus embodiments, the stylus may include aposition signal transmitter for transmitting position signals, areference signal transmitter for transmitting reference signals and/or aposition signal receiver for receiving position signals.

According to any of the stylus embodiments, at least a portion of thestylus housing may be clear or opaque such that it is possible to seethe writing element within the housing. The clear or opaque portion maybe sized and positioned to allow a user to determine a color of thewriting element through the portion. The clear or opaque portion mayalso be sized and positioned to allow a user to see an amount of writingmedia that the writing element contains. For example, when chalk,graphite or a liquid ink reservoir is used in conjunction with thewriting element, it is also possible to observe how much writing mediais remaining.

According to any of the stylus embodiments, the stylus housing mayinclude an aperture which allows a user to rotate a writing elementabout its longitudinal axis housed within the stylus housing withouthaving to disassemble the stylus housing or remove the writing elementfrom the stylus housing. It is noted that some writing elements includea tip which is not symmetrical about the longitudinal axis of thewriting element, such as a wedge shaped tip of a marker. In suchinstances, it may be desirable to periodically alter the angularpositioning of the tip of the writing element. This may be accomplishedby rotating the writing element through the aperture without having toremove the writing element from the stylus housing or having todisassemble the stylus.

According to any of the stylus embodiments, the stylus may furtherinclude a sensor adjacent the distal end of the stylus housing fordetecting a condition of media in the stylus. For example, the stylusmay include a sensor adjacent an end of the stylus housing out of whichthe writing element extends which serves to detect if the writingelement is low on writing media. In one variation, the sensor detects awater content or another solvent content of the portion of the writingelement extending from the housing, thereby alerting the user when thewriting element needs to be replaced.

According to any of the stylus embodiments, the stylus may include amechanism for distinguishing between different writing elements by onlypermitting a particular type of writing element (for example, based oncolor) to be positioned within the housing. In one variation, thewriting element may have a shaped portion associated with a particularcolor, such as the end of the element opposing the tip. Meanwhile, themechanism in the housing may have a shape which only allows a writingelement having a particular shaped portion to fit within the housing,thereby preventing other types of writing elements from being positionedwithin the housing. This embodiment is useful for allowing a set ofstyluses to be color coded.

According to any of the stylus embodiments, the position signaltransmitter may transmit a variety of signals including an ultrasoundsignal, a radar signal, or a micro-impulse radar signal.

According to any of the stylus embodiments, stylus may further include areference signal transmitter for transmitting a reference signal whenthe writing element is sensed by the contact switch to be in contactwith the writing surface. The reference signal transmitter may transmita variety of signals including infra-red signals and ultrasound signals.

According to any of the stylus embodiments, the stylus may furtherinclude a contact switch for sensing when the writing element iscontacted with a writing surface, the position signal transmittertransmitting the position signal when the writing element is sensed bythe contact switch to be in contact with the writing surface. Accordingto this variation, the stylus may further include a reference signaltransmitter which transmits a reference signal when the writing elementis sensed by the contact switch to be in contact with the writingsurface.

According to any of the stylus embodiments, the stylus may furtherinclude a cap removably attachable to the stylus housing distal end andsized to cover the portion of the writing element which extends from thestylus housing distal end. The cap preferably forms a seal with thestylus housing to prevent the writing element from drying out. The capmay be formed of a material which allows a user to observe the color ofthe writing element without having to remove the cap. For example, thecap may optionally be clear or opaque. Also the position signaltransmitter may be positioned adjacent the distal end of the stylushousing and the cap may be sized to fit over the position signaltransmitter.

Other embodiments of styli which may be used in the transcription systemof the present invention, and variations thereof, are described hereinand are intended to be encompassed within the scope of the presentinvention.

The present invention also relates to the use of a temperature sensorfor measuring a temperature adjacent the writing surface. Thetemperature sensor may be incorporated into one or more components ofthe transcription systems described herein, such as writing surfaces,styluses, detectors, detector assemblies, coupling members andsub-members, attachment members, hardware units, and templates. Changesin temperature can alter the speed at which position signals travel.Measurement of temperature using the temperature sensor can be used toaccount for these changes.

Various transcription systems embodiments can be designed in view of thepresent invention. Some specific examples of transcription systemsembodiments are as follows.

In one embodiment, the transcription system includes a plurality ofsignal receivers for positioning adjacent a writing surface and forreceiving a position signal transmitted from a stylus when the stylus ispositioned adjacent the writing surface, the signal receivers producingtiming signals in response to receiving the position signal from thestylus, the transcription system using the timing signals to determine aposition of the stylus adjacent the writing surface.

In another embodiment, a transcription system includes at least onesignal receiver for receiving a first power signal transmitted from astylus and for producing a second power signal, the first and secondpower signal having information concerning a power level of a powersource included in the stylus; a hardware unit receiving the secondpower signal from the at least one signal receiver and having logic forprocessing the second power signal to determine the power level of thepower source; and an indicator coupled with the hardware unit toindicate to a user the power level of the power source within thestylus.

According to this embodiment, a signal receiver may be included in adetector which is configured to be coupled with the writing surface.Also according to this embodiment, the signal receiver may be includedin a coupling member which couples a first detector to a seconddetector, the first and second detectors being in electricalcommunication with the hardware unit. According to this embodiment, thesignal receiver may be included in the hardware unit. Also according tothis embodiment, the signal receiver may include a photo sensor and thepower signal may be encoded into an infra-red signal transmitted fromthe stylus. Also according to this embodiment, the signal receiver mayinclude a piezoelectric material and the power signal may be encoded ina sonic signal transmitted from the stylus.

Other embodiments of transcription systems according to the presentinvention are described herein and are intended to be encompassed withinthe scope of the present invention.

One or more components of the transcription systems described herein,such as detectors, detector assemblies, coupling members andsub-members, attachment members, hardware units, and templates canoptionally be permanently incorporated into articles which can be usedas writing surfaces, such as whiteboards, chalk boards, or furniturewhich includes either a writing surface or a mechanism for attaching awriting surface to the furniture. For example, it is envisioned thatthese components of the transcription system may be incorporated intodesks and other types of office furniture.

Kits for use with the various embodiments of the transcription systemand its components are also provided. In its broadest sense, kits areprovided which include any two same or different components of thevarious embodiments of transcription systems described herein. Types ofcomponents provided herein include, but are not limited to writingelements, writing surfaces such as paper, whiteboards, chalkboards, andglass, styluses, stylus caps, detectors, detector assemblies, couplingmembers and sub-members, attachment members, hardware units, templates,and logic in computer readable form for use in the various transcriptionsystems.

Some specific examples of kit embodiments are as follows. In oneembodiment, a kit is provided which includes first and second signalreceivers for positioning adjacent a writing surface and for receiving aposition signal transmitted from a stylus when the stylus is positionedadjacent the writing surface. The signal receivers produce timingsignals in response to receiving the position signal from the stylus.The kit also includes a template which is coupleable to the writingsurface and which has markings defining a perimeter of at least onecontrol section sized to have a writing portion of the stylus positionedwithin the perimeter of the at least one control section. The kit alsoincludes a computer readable medium including logic for identifying whenthe portion of the stylus is positioned within the perimeter of a givencontrol section and for directing a processing unit of the transcriptionsystem to carry out a function associated with the given controlsection.

In another embodiment, the kit includes a writing surface containing abackground image. The kit also includes a computer readable mediumincluding instructions which when performed by a processor to create thebackground image on a monitor. The computer readable medium alsoincludes instructions for forming a composite image corresponding to acombination of the background image and the image written upon thewriting surface. According to this embodiment, the writing surface maybe a blank form, such as a spreadsheet. Using this kit, it is possibleto take a blank form such as a spreadsheet and fill out the blank formon the writing surface while simultaneously recording the same blankform being filled out.

In yet another embodiment, a kit is provided for use with atranscription system which includes a plurality of signal receivers forpositioning adjacent a writing surface and for receiving one or moreposition signals transmitted from a stylus when the stylus is positionedadjacent the writing surface, the signal receivers producing timingsignals in response to receiving position signals from the stylus, thekit comprising:

a template coupleable to the writing surface, the template including oneor more control sections; and

a computer readable medium including logic for detecting when the styluscontacts a particular control section based on receipt by the signalreceivers of one or more position signals transmitted from the stylusand logic for causing a function to be performed by the transcriptionsystem in response to detecting that the stylus has contacted theparticular control section.

According to this kit embodiment, the template may include a pluralityof control sections, the logic for causing a function to be performedincluding logic for causing different functions to be performeddepending on which of the plurality of control sections are contacted bythe stylus.

According to this kit embodiment, the template may be comprised of asheet of paper or plastic. The template may be devoid of electroniccircuitry. The template may also not send or receive signals.

Also according to this kit embodiment, the template may include at leasttwo calibration marks and the computer readable medium includes logicfor determining a position of the template on the writing surfacerelative to the signal receivers based on the stylus contacting thetemplate at the at least two calibration marks.

According to this kit embodiment, the computer readable medium mayinclude logic for causing an image displayed on a monitor operativelyconnected to the transcription system to change when the stylus contactsa particular control section.

According to this kit embodiment, the computer readable medium mayinclude logic for causing an image displayed on a monitor operativelyconnected to the transcription system to be saved when the styluscontacts a particular control section, deleted when the stylus contactsa particular control section, printed when the stylus contacts aparticular control section, facsimiled when the stylus contacts aparticular control section, or electronically mailed when the styluscontacts a particular control section.

According to this kit embodiment, the one or more control sections mayinclude control sections for performing calculator functions, thecomputer readable medium including logic for performing the calculatorfunctions when the stylus contacts particular control sections.

According to this kit embodiment, the computer readable medium mayinclude a data file identifying the positions of the control sections ofthe template.

According to this kit embodiment, the kit may include a plurality ofdifferent templates and the computer readable medium may include one ormore data files for the plurality of different templates which identifypositions of control sections on each template, the computer readablemedium further including logic which allows a user to select which ofthe plurality of templates is going to be used.

According to this kit embodiment, the computer readable medium mayinclude logic which allows a user to specify what function is performedby the transcription system in response to the stylus contacting aparticular control section.

In another embodiment, a kit is provided for use with a transcriptionsystem which includes a plurality of signal receivers for positioningadjacent a writing surface and for receiving position signalstransmitted from a stylus when the stylus is positioned adjacent thewriting surface, the transcription system recording writing performed bythe stylus on the writing surface. According to this embodiment, the kitcomprises

a background image coupleable to the writing surface; and

a computer readable medium including

logic for detecting a position of the background image on the writingsurface,

logic for detecting a position of the stylus relative to the backgroundimage on the writing surface,

logic for recording writing by the stylus relative to the backgroundimage, and

logic for forming a composite image comprising the background image andthe writing by the stylus on the background image.

According to this embodiment, the background image may comprise a sheetof paper or plastic. The background image may be formed of a materialwhich allows the writing by the stylus to be erased. The backgroundimage may be devoid of electronic circuitry and does not send or receivesignals. The background image may comprises a blank form of a computerapplication or a spreadsheet. The background image may comprise at leasttwo calibration marks and the computer readable medium includes logicfor determining a position of the background image on a writing surfacebased on the stylus being positioned adjacent to the background image atthe at least two calibration marks.

The computer readable medium may optionally include logic for causing animage displayed on a monitor operatively connected to the transcriptionsystem to change when the stylus is placed adjacent to a particularportion of the background image.

The computer readable medium may optionally include logic for causingthe composite image to be saved, deleted, printed, facsimiled, orelectronically mailed when the stylus is placed adjacent to a particularportion of the background image.

Although various versions of computer readable medium are describedabove as being a part of various kit embodiments, it is noted that thecomputer readable medium may also be provided separately from the kits.

A variety of different methods are also provided for use withtranscription systems according to the present invention.

In one embodiment, a method is provided which comprises:

positioning a pad adjacent the writing surface, the pad including one ormore input sections;

positioning the stylus adjacent a particular input section, the stylustransmitting a position signal in response;

having the transcription system determine that the stylus has beenpositioned adjacent the particular input section and perform a functionassociated with the particular input section in response.

According to this embodiment, the input section may be a calibrationmark, the function performed by the transcription system beingcalibration of the transcription system by determining a separationbetween the signal receivers.

Also according to this embodiment, the function associated with theinput section may be modifying an image displayed on a monitoroperatively connected to the transcription system, the transcriptionsystem modifying the image in response to determining that the styluscontacted the save input section. The function associated with the inputsection may also be saving an image displayed on a monitor operativelyconnected to the transcription system, the transcription system savingthe image in response to determining that the stylus contacted the saveinput section. The function associated with the input section may alsobe erasing an image displayed on a monitor operatively connected to thetranscription system, the transcription system erasing the image inresponse to determining that the stylus contacted the save inputsection. The function associated with the input section also may bechanging a color of an image displayed on a monitor operativelyconnected to the transcription system, the transcription system changingthe color of the image in response to determining that the styluscontacted the save input section.

Associated with this method is a computer readable medium including:

logic for taking a file encoding positions of one or more input sectionson a pad to be positioned adjacent the writing surface and associatingwith the one or more input sections a function to be performed when thestylus is detected as having been positioned adjacent to one of theinput sections;

logic for determining that the stylus has been positioned adjacent to aparticular input section based on times of flight of position signalsfrom the stylus adjacent the particular input section to the pluralityof signal receivers; and

logic for causing the transcription system to perform the functionassociated with the input section in response to determining that thestylus has been positioned adjacent to the particular input section.

In one variation, the function associated with the input section may bemodifying an image displayed on a monitor operatively connected to thetranscription system, the logic for causing the transcription system toperform a function including logic for causing the transcription systemto modify the image in response to determining that the stylus contactedthe save input section.

In another variation, the function associated with the input section issaving an image displayed on a monitor operatively connected to thetranscription system, the logic for causing the transcription system toperform a function including logic for causing the transcription systemto save the image in response to determining that the stylus contactedthe save input section.

In yet another variation, the function associated with the input sectionis erasing an image displayed on a monitor operatively connected to thetranscription system, the logic for causing the transcription system toperform a function including logic for causing the transcription systemto erase the image in response to determining that the stylus contactedthe save input section.

Also associated with this method is a transcription system comprising:

a stylus which transmits position signals when positioned adjacent awriting surface;

a plurality of signal receivers for positioning adjacent the writingsurface which receive the position signals transmitted from the stylusand produce timing signals in response;

a pad for positioning adjacent the writing surface, the pad includingone or more input sections; and

a processing unit including logic for taking a file encoding positionsof the one or more input sections on the pad and associating with eachinput section a function to be performed when the stylus is detected ashaving been positioned adjacent the input section, logic for determiningthat the stylus has been positioned adjacent an input section based ontimes of flight of position signals from the stylus adjacent the inputsection to the plurality of signal receivers, and logic for causing thetranscription system to perform the function associated with the inputsection in response to determining that the stylus has been positionedadjacent to the input section. According to this embodiment, thefunction may be selected from the group consisting of modifying, saving,and erasing an image displayed on a monitor operatively connected to thetranscription system. Also according to this embodiment, the inputsection may be a calibration mark and the function performed by thetranscription system is calibration of the transcription system bydetermining a separation between the signal receivers.

A method is also provided comprising:

activating a user activated control switch mounted on the writingsurface;

producing as a result of activating the user activated control switch acontrol signal which is communicated to the transcription system; and

having the transcription system perform a function in response toreceiving the control signal.

According to the method, activation of the control switch may cause atleast a portion of an image displayed on a monitor operatively connectedto the transcription system to be modified.

Also according to the method, activation of the control switch may causeat least a portion of an image displayed on a monitor operativelyconnected to the transcription system to be erased, saved, printed,electronically mailed or facsimiled.

In another embodiment, a method is provided which comprises positioninga background image adjacent the writing surface such that the backgroundimage can be seen by a user;

having the transcription system determine a position of the backgroundimage relative to the signal receivers;

having the user write adjacent the background image using the stylussuch that the user sees a composite image comprising the backgroundimage and the writing;

having the transcription system detect the writing by detecting theposition of the stylus; and

having the transcription system create an electronic equivalent of thecomposite image by combining the background image with the writing.

According to the method, the method may further comprise displaying theelectronic equivalent of the composite image on a monitor operativelyconnected to the transcription system.

Also according to the method, positioning the background image adjacentthe writing surface may include attaching a sheet of material includingthe background image adjacent the writing surface.

Also according to the method, the sheet may be attached to the writingsurface. The sheet may be erasable. The sheet may comprise paper orplastic.

Also according to the method, the writing surface may be translucent andthe sheet may be positioned behind the writing surface.

Also according to the method, positioning the background image adjacentthe writing surface may include displaying the background image adjacentthe writing surface. Displaying the background image adjacent thewriting surface can include projecting the background image onto thewriting surface.

Also according to the method, the background image may comprise a screenfrom a computer application. The background image may comprise a varietyof images including a website, a spreadsheet, or a grid.

According to the method, the background image may comprise at least twocalibration marks and determining a position of the background imagerelative to the signal receivers may include placing the stylus adjacentthe calibration marks.

Also according to the method, the background image may comprise one ormore control sections, the method further including causing thetranscription system to perform a function by placing the stylusadjacent one of the control sections. The function performed by thetranscription system may include modifying an image displayed on amonitor operatively connected to the transcription system. The functionperformed by the transcription system may also include removing at leasta portion of the composite image from an image displayed on a monitoroperatively connected to the transcription system, saving the electronicequivalent of the composite image, deleting the electronic equivalent ofthe composite image, and printing the electronic equivalent of thecomposite image.

In another embodiment, a method is providing for correcting for theeffect of temperature on the speed of ultrasound signals in thetranscription system. The method comprises measuring a temperatureadjacent a writing surface where an ultrasound transcription system isbeing employed; and adjusting time of flight calculations using themeasured temperature adjacent the writing surface. Temperature ispreferably measured periodically in order to account for changes incondition, for example, a change in whether sunlight is impacting uponthe writing surface. This method may be employed in combination with anyof the other methods of the present invention, According to thesemethods, temperature sensors may optionally be incorporated into thestylus, template and/or positioned adjacent one or more of thedetectors.

A method is also provided for forming or modifying an image displayed ona monitor or projected on a surface by forming that image or modifyingthat image on a writing surface using a stylus and transcription systemof the present invention. It is noted that modifying the image mayinclude erasing a portion of the image on the writing surface whichcauses the erased portion to be removed from the monitor or projectedimage.

A variety of calibration methods are provided. In one embodiment, thecalibration method comprises:

attaching the plurality of signal receivers to the writing surface atunknown distances from one another, each signal receiver including acalibration mark at a known position relative to the signal receiver;

transmitting position signals from each calibration mark; and

using times of flight of the position signals to determine separationdistances between the plurality of signal receivers.

According to this embodiment, the position signals may be transmittedfrom a stylus by contacting the stylus to the calibration marks.

In another embodiment, a method is provided which comprises:

positioning a pad adjacent the writing surface, the pad including aplurality of calibration marks;

positioning the stylus adjacent to each calibration mark, the stylustransmitting a position signal to the signal receivers in response;

having the transcription system determine separations between the signalreceivers based on times of flight between the calibration mark and thesignal receivers.

According to this embodiment, two calibration marks and two signalreceivers may be utilized to perform the method.

In another embodiment, the method comprises:

attaching a template to the writing surface, the template having two ormore calibration marks at known separation distances from one another;

transmitting position signals from a stylus at the two or morecalibration marks to at the signal receivers;

using times of flight of the position signals from the calibration marksto the signal receivers to determine separation distances between thecalibration marks and the signal receivers; and

using the determined separation distances between the calibration marksand the signal receivers and the known separation distances between thecalibration marks to determine separation distances between the signalreceivers.

According to this embodiment, the method may optionally further includedetermining the position of the template on the writing surface relativeto the signal receivers. Also according to this embodiment, the templatemay include one or more control sections at known positions relative tothe calibration marks, the method further including determining theposition of the one or more control sections relative to the signalreceivers.

Associated with these calibration methods are computer readable mediumfor performing all or a portion of these methods.

In one embodiment, the computer readable medium comprises:

logic for taking times of flight of position signals from calibrationmarks on a template attached to a writing surface to a plurality ofsignal receivers attached to the writing surface, the calibration marksbeing at known separation distances from each other, and using the timesof flight to determine separation distances between the calibrationmarks and the signal receivers; and

logic for using the determined separation distances between thecalibration marks and the signal receivers and the known separationdistances between the calibration marks to determine separationdistances between the signal receivers.

According to this embodiment, the computer readable medium may furtherinclude logic for determining the position of the template on thewriting surface relative to the signal receivers.

Also according to this embodiment, the template may include one or morecontrol sections at known positions relative to the calibration marks,the computer readable medium further including logic for determining theposition of the one or more control sections relative to the signalreceivers.

Also according to this embodiment, the template may include a mouseregion which serves as a virtual touch pad for the user. In this regard,the user can move the stylus within the mouse region and cause a cursorassociated with the system to move. Thus, by moving the stylus withinthe mouse region, the stylus can serve as a mouse for the system. Inthis embodiment, the system includes logic for utilizing the movement ofthe stylus within the system as a mouse.

Also according to this embodiment, the template may include a graffitiregion which can recognize handwritten signals, such as handwritinggraffiti used with the PALM PILOT. In this embodiment, the systemincludes logic for utilizing the movement of the stylus within thegraffiti region and translating that movement into handwritten signals.

In another embodiment, the computer readable medium includes

logic for taking times of flight of position signals from calibrationmarks to signal receivers and using the times of flight to determineseparation distances between the signal receivers.

It is noted in regard to methods of the present invention that thesemethods employ logic and a processor for executing the logic. The logicmay be software or firmware and may be stored in any form ofcomputer-readable medium including diskettes, CDs, and hard drives. Thelogic may also be maintained on a server. The present invention isintended to encompass any device which includes logic for performing anymethod according to the present invention. The present invention is alsointended to encompass any form of computer-readable medium whichincludes logic for performing any method according to the presentinvention.

Each of the above methods is preferably performed by a processor.Accordingly, an aspect of the present invention relates to acomputer-readable medium, such as a diskette, CD, or hard drive whichincluding instructions to be carried out by a processor for performingthe various methods of the present invention. The present invention alsorelates to a computer, PDA, server, and the like which incorporateslogic for performing the various methods of the present invention.

BRIEF DESCRIPTION OF THE FIGURES

FIG. 1A illustrates several components of a transcription system.

FIG. 1B illustrates installation of the transcription system.

FIG. 1C illustrates calibration of a transcription system.

FIG. 1D illustrates operation of a transcription system.

FIG. 1E illustrates operation of an eraser which can be used with atranscription system.

FIG. 1F illustrates operation of a template having control sectionscorresponding to the key pad of a calculator.

FIG. 1G illustrates a template with control sections and iconsindicating the function correlated with each control section.

FIG. 1H illustrates a stylus creating a written image on a writingsurface containing a background image to form a composite image whilethe same composite image is being formed on the monitor.

FIG. 1I illustrates a composite image comprising an image of a webpageprojected onto a writing surface and writing on the writing surface incombination to with the composite image being displayed on a monitor andprojected on a separate surface.

FIG. 2A illustrates a transcription system where a stylus receives areference signal and transmits a position signal.

FIG. 2B illustrates a transcription system where a stylus receives areference signal via an electrical wire.

FIG. 2C illustrates a transcription system where a stylus transmits aposition signal and a reference signal.

FIG. 2D illustrates a transcription system where a stylus transmits twodifferent reference signals in response to receiving different positionsignals.

FIG. 3A illustrates dimensions of a writing area.

FIG. 3B illustrates a transcription system where a first detectorincludes a position signal transceiver or transmitter for responding toa reference signal from a second detector.

FIG. 3C illustrates a transcription system where a first detectorincludes a calibration mark for calibrating the transcription system.

FIG. 3D illustrates a detector assembly where a first and seconddetectors are separated by a coupling member.

FIG. 3E illustrates a detector assembly where a first and seconddetectors are positioned along a side of the writing area.

FIG. 4A is a side view of a stylus which may be used in a transcriptionsystem according to the present invention.

FIG. 4B is a side view of a stylus including a removable cap.

FIG. 4C is a disassembled side view of a stylus including a stylushousing, a door and a stylus.

FIG. 4D is a side view of the stylus illustrated in FIG. 4C assembled.

FIG. 4E is a side view of a stylus coupled to a transcription system byan electrical wire for providing a reference signal to the stylus.

FIG. 4F is a side view of a cap according to the present invention.

FIG. 4G is a side view of a stylus with a cap in place.

FIG. 4H is a cross section of a stylus coupled with a cap adapted toaccommodate a position signal transmitter or receiver.

FIG. 4I is a cross section of a stylus coupled with a cap adapted toaccommodate a position signal transmitter or receiver.

FIG. 4J is a cross section of a stylus with a ridge coupled with a cap acap adapted to accommodate a position signal transmitter or receiver.

FIG. 4K illustrates a stylus embodiment where the stylus electronics arepositioned toward a distal end of the stylus adjacent the tip.

FIG. 4L illustrates a stylus embodiment where an elongated writingelement is employed which allows the diameter of the stylus to befurther reduced.

FIG. 5A is a side view of an eraser for use with a transcription system.

FIG. 5B is a bottom view of the eraser illustrated in FIG. 5A.

FIG. 6A is a side view of a detector.

FIG. 6B is a bottom view of a detector.

FIG. 7A is a perspective view of a detector including a 180 degree rangeof reception.

FIG. 7B is a side view of a detector including a 180 degree range ofreception.

FIG. 7C is a perspective view of a detector including a 90 degree rangeof reception.

FIG. 7D illustrates a detector assembly which includes a hardware unitwith control switches and indicators.

FIG. 7E is a side view of a detector assembly with a coupling memberwhich serves as a hardware unit.

FIG. 7F is a top view of a detector assembly with a coupling memberwhich serves as a hardware unit.

FIG. 7G is a top view of a detector assembly capable of adopting two ormore configurations.

FIG. 7H is a side view of a detector assembly capable of adopting two ormore configurations.

FIG. 7I is a side view of a detector assembly having first and secondhinges which permit the detector assembly to adopt two or moreconfigurations.

FIG. 7J is a side view of a detector assembly where a coupling member isconstructed from a second member slidably positioned within a firstmember.

FIG. 7K is a top view of a detector assembly where a coupling member isconstructed from a second member is slidably positioned within a firstmember.

FIG. 7L is a side view of a detector assembly where a coupling member isconstructed from first and second members which are detachable from oneanother.

FIG. 7M illustrates a user activatable attachment mechanism which can beused to coupled a detector or coupling member with a writing surface.

FIG. 7N illustrates a detector with a shielding element which shields aposition signal receiver from position signals transmitted from outsidea predetermined region extending over about 90 degrees.

FIG. 7O illustrates a detector with a shielding element which shields aposition signal receiver from position signals transmitted from outsidea predetermined region extending over about 180 degrees.

FIG. 8A illustrates a block diagram which can be used with the systemillustrated in FIG. 2A.

FIG. 8B illustrates a block diagram which can be used with the systemillustrated in FIG. 2C.

FIG. 8C illustrates a block diagram which can be used with the systemillustrated in FIG. 2D.

FIG. 9 is a circuit for triggering transmission of a position signal inresponse to receiving a reference signal.

FIG. 10 is a circuit which can be used to detect when a position signalhas been received at a detector.

FIG. 11A illustrates dimensions of writing area and monitor image area.

FIG. 11B illustrates coordinate systems transposed on the writing areaand the monitor image area when the first and second detectors areposition along the top of the writing area.

FIG. 11C illustrates coordinate systems transposed on the writing areaand the monitor image area when the first and second detectors areposition along a side of the writing area.

FIG. 11D illustrates creation of a monitor image.

FIG. 12 is a block diagram of a processing unit.

FIG. 13 illustrates an image data structure used to store a series ofstylus positions.

FIG. 14 is a implement characteristic data structure used to identifywhether an implement is an eraser or a stylus and to identify thecharacteristics of each stylus.

FIG. 15A is an control section relative to template data structure.

FIG. 15B is an control section relative to detectors data structure.

FIG. 16A is a process flow of a calibration module.

FIG. 16B is a process flow for determining the dimensions of a writingarea in a transcription system as illustrated in FIG. 3B.

FIG. 17 is a process flow for determining the positions of the stylusrelative to the detectors and creating the monitor image from thedetermined positions.

FIG. 18 is a process flow for erasing a monitor image by erasing thewritten image.

FIG. 19A is a process flow for stylus identification logic.

FIG. 19B is a process flow for stylus identification logic which iscomplementary to the process flow illustrated in FIG. 19A.

FIG. 20 illustrates background image calibration logic.

FIG. 21 illustrates an embodiment of a transcription system kit.

FIG. 22 illustrates a stylus which has been taken apart so that a markercan be placed within the stylus.

FIG. 23A illustrates a side view of the stylus where the stylus cover isin full view.

FIG. 23B illustrates a side view of the stylus where the stylus cover ison top and the stylus body is below.

FIG. 24A illustrates the detector assembly unfolded.

FIG. 24B illustrates the detector assembly attached to a whiteboardsurface via the suction cup assemblies.

FIG. 24C illustrates the user inputs on the detector assembly.

FIG. 25 illustrates how the detector assembly can be attached to aprocessor via a connection cable.

FIG. 26A illustrates a user interface for the transcription system.

FIG. 26B illustrates a whiteboard with a detector assembly attached anda smiley face written using a transcription system stylus.

FIG. 26B also illustrates the user interface which shows anelectronically transcribed image of the smiley face.

FIG. 27A illustrates the user interface in greater detail and some ofthe functions which the user interface 550 performs.

FIG. 27B illustrates the display toolbar and its operation.

FIG. 27C illustrates the navigation toolbar and its operation.

FIG. 27D illustrates the template in greater detail.

FIG. 27E(1) illustrates the template and the detector assembly on awriting surface.

FIGS. 27E(2-4) illustrate a sequence of images displayed on a userinterface to allow the transcription to determine the position of thetemplate relative to the detector assembly on the writing surface

FIG. 28A illustrates a window which allows the user to configure thewriting surface.

FIG. 28B illustrates a window which allows the user to configure thestylus.

DETAILED DESCRIPTION Transcription System Overview

The present invention relates to a system for recording writingperformed on a surface and its components and related methods where theposition of a stylus used in the system to write on the surface istracked using signals. Writing is intended to include the formation ormodification of any type of image on a surface by a writing element,including printing, drawing, sketching, erasing and the like. Thesurface on which the writing is performed may be any surface on whichwriting may be performed. Examples of suitable surfaces include but arenot limited to, whiteboards, blackboards, clipboards, desktops, walls,projection screens, flip chart tablets, and glass panes whether or notcovered by a material such as paper, glass, metal, or plastic which canbe written upon. The surface is preferably a relatively smooth andrelatively flat surface, although it is noted that the surface may havea degree of curvature.

In a system according to the present invention, a stylus including ahousing and a writing element is provided. The writing element mayoptionally be removable from the housing. In one embodiment, the writingelement is removed from an end of the housing while in anotherembodiment the writing element is removable from a side of the stylushousing. Also provided are two or more detectors which may bepermanently or removably affixed to a writing surface and are used incombination with the stylus to detect the position of the stylus on thewriting surface. Also provided in the system is hardware for controllingwhen reference and position signals, described herein, are sent betweenthe stylus and the two or more detectors.

The system may also include a processing unit which contains logic andprocessing capabilities for performing the various calibration andcalculation functions necessary to determine the position of the stylusrelative to the two or more detectors at multiple times over a period oftime that the stylus is used to write. Alternatively, the system mayproduce signals corresponding to timing data which can be communicatedto a processor external to the system for providing positioning data.

Incorporated into the stylus and the plurality of detectors are one ormore transmitters and one or more receivers for transmitting andreceiving signals between the stylus and detectors. Used in combination,the one or more transmitters and one or more receivers determine aseparation between the stylus and the plurality of detectors based on atime of flight of the signals between them which can be used todetermine a positioning of the stylus. As will be discussed in greaterdetail below, a variety of ranging media can be used in the systemincluding, for example, ultrasound and radar, such as MIR.

FIG. 1A illustrates one embodiment of a transcription system accordingto the present invention. As illustrated, the system includes a stylus10, a first detector 12A, a second detector 12B and a hardware unit 14.As illustrated, the system can optionally include an eraser 16, template18, processing unit 20, monitor 22 and user interface 24. The userinterface can be typical devices which allow users to interact withprocessing unit, hardware controllers and other processor based systems.For instance, the user interface can include a keyboard, and/or a mouseor even a touchpad imposed on the monitor 22.

Signals from the first detector 12A and the second detector 12B may betransmitted to the hardware unit 14 through a wire 26. These signals maybe electrical or optical in nature. The signals can also be transmittedwirelessly to the hardware unit 14, for example through a form ofelectromagnetic radiation. As will be explained below, the system canalso be designed such that signals are transmitted from the stylus 10 orthe eraser 16 to the hardware unit 14. Suitable wires for transmittingthe signals include cables similar to the cables used for standardtelephone to jack connections. The detectors 12A, 12B and the hardwareunit 14 can include ports which receive the cables which can be easilywithdrawn from the ports.

FIG. 1B illustrates how the transcription system illustrated in FIG. 1Amay be installed relative to a writing surface 28. The first detector12A and the second detector 12B are removably coupled to the writingsurface 28. As illustrated by the arrows 30, the first detector 12A andsecond detector 12B can be placed anywhere on the writing surface 28.However, it is generally preferred that the first detector 12A and thesecond detector 12B be positioned adjacent an edge of the writingsurface 28. It is also noted that the first detector 12A and the seconddetector 12B may optionally be permanently attached to the writingsurface 28.

As illustrated in FIGS. 1A and 1B, a template 18 positioned on oradjacent to the writing surface can be used to control the transcriptionsystem using a stylus adjacent the writing surface. As illustrated, thetemplate 18 includes markings which define the perimeter of severalcontrol sections 32. The control sections on the template 18 can be usedto initiate functions which are carried out by the hardware unit 14and/or the processing unit 20. An advantage of the template is that itallows the user to control the monitor image 34 and the transcriptionsystem through the template as opposed to the user interface 24.

Examples of functions that can be associated with a control sectioninclude, but are not limited to, causing the current monitor image 34 tobe saved; causing the current monitor image 34 to be saved and moved tothe background while a new monitor image area 36 is brought to theforeground for the creation of a new monitor image 34; causing thecurrent monitor image 34 to be moved to the background while a newmonitor image area 36 is brought to the foreground for the creation of anew monitor image 34; causing a copy of the current monitor image to besaved in the background while the current monitor image remains in theforeground for any additional adjustments; causing the entire monitorimage 34 to be erased while retaining the current monitor image area 36in the foreground; bringing a new monitor image area 36 into theforeground; maximizing the size of the current monitor image area 36 tofill the available space on the monitor; bringing the last monitor imagearea 36 to the foreground when another program was last used in theforeground; initiating calibration or recalibration of the transcriptionsystem; enabling or disabling selected functions; changing or selectingthe color of particular strokes on the monitor image 34 or changing theparticular color correlated with a particular stylus 10; faxing themonitor image 34; E-mailing the monitor image 34; and/or printing themonitor image 34.

In one embodiment, the template includes a mouse region which serves asa virtual touch pad for the user. In this regard, the user can move thestylus within the mouse region and cause a cursor associated with thesystem to move. Thus, by moving the stylus within the mouse region, thestylus can serve as a mouse for the system. In this embodiment, thesystem includes logic for utilizing the movement of the stylus withinthe system as a mouse.

In another embodiment, the template includes a graffiti region which canrecognize handwritten signals, such as handwriting graffiti used withthe PALM PILOT. In this embodiment, the system includes logic forutilizing the movement of the stylus within the graffiti system andtranslating that movement into handwritten signals.

A background image can also be positioned on the writing surface.Alternatively, the background image may be projected onto or printedonto the writing surface itself. In a sense, the background image servesas a template for forming a composite image comprising a combination ofthe written image and the background image. One or more control sectionscan be used in combination with the background image in order to alignthe positioning of the written image relative to the background image sothat the composite image recorded by the system is substantially thesame as the composite image formed on the writing surface by the user.

The background image may include a blank form of a computer application,such as an EXCEL spreadsheet or a POWERPOINT slide. As a result, writingwithin the blank form causes entries to be entered into thecorresponding locations in the computer program as they appear on thebackground image. The background image can also be graphics, such as awebpage, where the user writes on the writing surface and thereby editsthe graphics by forming a composite image.

The control sections 32 can also be used to control the variousfunctions of other programs. For instance, during a presentation to agroup, the transcription system can be used simultaneously with otherprograms such as POWER POINT. For example, positioning the writingportion of the stylus within a particular control section 32 can causePOWER POINT to move to the next slide or display. Similarly, positioningthe writing portion of the stylus within a different section 32 cancause POWER POINT to move to the previous slide or display. As a result,a user can scroll through the slides of a presentation and capture anynotes the user makes on a writing surface 28 during the presentation. Inthis regard, the template can also function as a remote control or mousefor the system for various computer applications.

As can be seen from the above illustrative list of how a template can beused, a wide variety of additional system functions can be envisionedand are intended to fall within the scope of the present invention. Thevarious control sections of the template can be defined with differentcolored sections of the template 18 or outlined sections of the template18.

Templates used with the system can be selected from a series ofdifferent templates stored into memory which are recognized by thetranscription system. In use, the system is instructed as to whichtemplate has been selected. Optionally, the template may be selected byprinting the template out from memory. Once selected, the template isplaced adjacent the writing surface.

Templates may also be user defined. In one variation, a template is userdefined within a program employed with the system. The user definedtemplate is then printed out and the system is instructed that templatewill be used. In another variation, a template is user defined bydrawing the template on the writing surface in combination withinstructing a program employed with the system that the template beingdrawn is to be used. Predetermined control signal images, in combinationwith handwriting recognition can be used to assist the system in readingthe template into memory that is drawn on the writing surface.

The template 18 can be constructed from any material suitable forattaching to a flat surface such as a piece of paper on which a templatehas been printed and a thin plastic sheet which can attach itself to thewriting surface 28 via static cling. A feature of the present inventionis that the template may be devoid of electronic circuitry and need notreceive or transmit any signals.

When a template is employed, the template is preferably positioned at adistance from the first detector and the second detector. For example,in FIG. 1A the template 18 is illustrated as being positioned on anopposite side of a writing area 38 relative to the first detector 12Aand the second detector 12B. Where possible, the template 18 is morepreferably positioned approximately equidistant from each of the firstdetector 12A and the second detector 12B on the opposite side of thewriting area 38 from the first detector 12A and the second detector 12B.Although the template 18 is shown to be removably attachable to thewriting surface 28, it is noted that the template 18 may optionally bepermanently attached to the writing surface 28.

In one embodiment, the transcription system is readily attachable to anddetachable from different writing surfaces 28. Detachability enables thetranscription system to be portable and to be used with differentwriting surfaces 28 and with different sized writing surfaces 28. It isnoted that attachment to a writing surface is intended to encompassattachment adjacent to a writing surface.

As will be explained below, when the transcription system is used withdifferent writing surfaces 28, it may be necessary to calibrate thesystem. During calibration, the distance between the detectors, L, canbe determined. In some embodiments of the system, the dimensions of thewriting area 38 are determined including the writing area width, W; thewriting area height, H; and the diagonal distance of the writing area,D. In other embodiments, the position of the template 18 is determinedduring the calibration.

Some embodiments of the system are self-calibrating, for example whenthe distance between detectors is fixed. In other embodiments, thesystem needs to be calibrated by the user. A variety of differentcalibration methods have been developed which optionally includeentering information into the user interface 24 and/or by the userfollowing a series of computer prompts.

FIG. 1C illustrates an example of a system which is calibrated by theuser following a series of computer prompts. As illustrated, during thecalibration, the user contacts one or more different calibration marks40 on the template 18 with the stylus 10. The calibration marks 40 canbe positioned on the template 18 as illustrated. The calibration marks40 can also be positioned on one or both the detectors 12A, 12B.

To prompt the user, the processing unit 20 may optionally produce animage on the monitor 22. For instance, the processing unit 20 can createa template image 42 on the monitor 22 as illustrated in FIG. 1C. Animage of a stylus can be shown contacting a calibration mark 40 of thetemplate image 42. In response, the user contacts the stylus 10 with thecalibration mark 40 on the template 18 as illustrated. In anotherembodiment, the processing unit 20 can create an image of a styluscontacting a calibration mark 40 on an image of a detector. In response,the user contacts a calibration mark 40 on the first detector 12A. Thetranscription system will be calibrated after the user follows eachprompt provided by the processing unit 20. Because the transcriptionsystem is easily calibrated by the user, the transcription system isreadily usable with different sized writing surfaces 28.

After the transcription system has been calibrated, the system isgenerally ready for use. As illustrated in FIG. 1D, the user can writein the writing area 38 with the stylus 10. While the user is creating animage in the writing area 38, a similar image appears in a monitor imagearea 36 of the monitor 22. The image in the writing area 38 is referredto as the written image 44 and the image on the monitor 22 is referredto as the monitor image 34. As illustrated in FIG. 1E, the written image44 can also be erased using an eraser 16. The monitor image 34 is erasedas the written image 44 is erased using the eraser 16.

Optionally, the system is periodically recalibrated during operation toaccount for temperature changes adjacent the writing surface. Changes intemperature can occur, for example, due to a change in whether sunlightis impacting upon the writing surface (e.g., opening or closing blinds,passage of time). These temperature changes can alter the speed at whichposition signals travel. Measurement of temperature can be used todetect these temperature changes and recalibrate the system accordingly.In one variation, a method is providing for correcting for the effect oftemperature on the speed of ultrasound signals in the transcriptionsystem comprising measuring a temperature adjacent a writing surfacewhere an ultrasound transcription system is being employed; andadjusting time of flight calculations using the measured temperatureadjacent the writing surface. This method may be employed in combinationwith any other calibration method.

The monitor image 34 can be stored for later editing and manipulation orcan be converted to a number of electronic and digital document formatsincluding, but not limited to, fax, e-mail, word processing programssuch as WORD and WORDPERFECT, graphic presentation and preparationprograms such as POWERPOINT, VISIO and design programs such as AUTOCAD.The monitor image can also be communicated in real time to remote usersvia a network, the INTERNET, phone lines or other communication media.The monitor image can also be projected either where the written imageis being formed or in a remote location. In one embodiment, soundpresent in the location where the written image is being formed andmodified is stored and/or communicated in combination with the monitorimage.

FIG. 1F illustrates one embodiment of a template 18 which includescontrol sections 32 which correlate to the keys on a calculator keypad.The template 18 includes a plurality of control sections 32corresponding to the keys on a calculator. Additional control sections32 corresponding to keys available on calculators but not illustrated inFIG. 1F are also contemplated for inclusion on the template 18. Further,control sections available on PC keyboards and/or personal digitalassistants (PDAs), but not illustrated in FIG. 1F, may also be includedon the template 18. Also illustrated in FIG. 1F is a calculator image 46displayed on the monitor 22. The calculator image 46 can be similar tothe calculator images commonly available in PC software. The calculatorimage 46 includes a display 48 where information is displayed to theuser. The calculator image 46 can also optionally include a keypad withkeys which are correlated to the control sections 32 included on thetemplate 18. The number and type of keys on the keypad can also differfrom the control sections 32 included on the template 18. The controlsections 32 can be used to control the display 48 on the calculatorimage 46. Specifically, positioning the stylus in a control section 32causes the processing unit 20 and/or the hardware unit 14 to carry out afunction associated with the control section 32. For instance,positioning the stylus 10 in the numerical control section 32 indicatingthe number 9 causes a number nine to appear in the display 48. As aresult, the control sections 32 on the template 18 can be used as thekeypad of a calculator and the display 48 on the calculator image 46 canbe used as the display 48 of the calculator.

The user interface 24 can be used to control the display 48 on thecalculator image 46. For instance, if the user interface includes akeyboard which is typically used with a PC, the keys on the keyboard canbe used to control the display 48 on the calculator image 46. Forinstance, pressing the number 2 on the keyboard can cause the number 2to appear in the display 48. Further, if the user interface includes amouse or other cursor control device, the cursor can be aligned with thekeys illustrated on the calculator image 46. Clicking the mouse whilethe cursor is aligned with a particular key causes the functionassociated with that key to occur.

The calculator image 46 can include keys which do not correspond to anyof the control sections 32 on the template 18. These keys can performfunctions which are not performed by positioning the stylus within anyof the control sections on the template 18. As described, the keys canbe activated with a typical user interface.

The calculator image 46 need not always be visible to the user. Forinstance, the calculator image 46 can be manually called up onto themonitor 22 by positioning the stylus in the function control section 32labeled "ON/C". The calculator image 46 can also be automatically calledup on the monitor 22 when the stylus is positioned in control sections32 corresponding to the calculator functions other than the functionalcontrol section 32 labeled "OFF". The calculator image 46 can beautomatically withdrawn from the monitor 22 after a pre-determinedperiod of time has elapsed. The calculator image 46 can also be manuallywithdrawn from the monitor 22 by positioning the stylus in the functioncontrol section 32 labeled "OFF".

When the calculator image 46 is called up, the calculator image 46 canreplace the monitor image area 36 on the monitor 22 or can appear overthe monitor image area 36 as illustrated in FIG. 1F. When the calculatorimage 46 appears over the monitor image area 36, the user can switchbetween the monitor image area 36 and the calculator image 46 by using auser interface 24 such as a mouse to position a cursor on the calculatorimage 46 or the monitor image area 36. As is known in Windowstechnology, when the cursor is positioned on the calculator image 46,the calculator image 46 will be moved to the front so it is in fullview. Similarly, when the cursor is positioned on the monitor image area36, the monitor image area 36 will be moved to the front so it is infull view.

It is noted that the image being formed on the writing surface may besimultaneously projected onto the same or a different surface, forexample on an adjacent projectable surface, onto the writing surface(front or rear projection) or in a remote location. In this regard, theuse of the template as a calculator as described above also allows theuser to project a calculator onto an adjacent projectable surface andperform calculations without the user having to move away from thewriting surface.

While the template is described above in terms of having calculatorfunctions, it has already been noted that the template may perform awide variety of functions and thus serve as a remote control device oruser interface for the user. This enables the user to operate variousapplications, such as the calculator described above, or a webbrowser(e.g., to locate bookmarks, go back and forth between screen) withouthaving to move away from the writing surface using the stylus and thetemplate and display images of that application. This allows the user toreadily transition between using the writing surface and the stylus as atranscription system and using a template and the stylus as a userinterface for a variety of programs.

The hardware unit 14 or the processing unit 20 can optionally include avoice synthesizer which audibly describes the functions performed as thestylus is positioned in a control section 32. For instance, when thestylus is positioned in the control section 32 labeled "2", the voicesynthesizer can audibly announce "two". When the stylus is positioned inthe control section 32 labeled "+", the voice synthesizer can audiblyannounce "plus". Further, when the stylus is positioned in the controlsection 32 labeled "=", the voice synthesizer can announce "equals" andthe result. For instance, if the stylus is sequentially positioned inthe control sections 32 labeled "1", "2", "x", ".", "0", "0", "3" and"=", the voice synthesizer would provide "one", "two", "times", "point","zero", "zero", "three", "equals", "zero", "point", "zero", "three","six". As a result, the voice synthesizer can eliminate the need for amonitor 22 and a calculator image 46.

Further, the display 48 can also be included on the hardware unit 14.For instance, the hardware unit 14 can include a liquid crystal or LEDdisplay as are commonly available in calculators. The display can thenbe controlled by positioning the stylus in the control sections on thetemplate 18 or by activating control switches on the hardware unit.

FIG. 1G illustrates another embodiment of a template 18 which issuitable for use with the transcription system. Although the previouslyillustrated control sections 32 are square or rectangular, the controlsections can have shapes including, but not limited to, triangular,elliptical, octagonal, hexagonal and round as is illustrated in FIG. 1G.FIG. 1G also illustrates the control sections 32 including icons or textwhich indicate to the user the function that will be performed bypositioning the writing portion of the stylus within the perimeter ofone of the control sections. Although the previously illustratedcalibration marks are illustrated as being positioned along one edge ofthe template 18, the calibration marks can be positioned anywhere on atemplate. Preferably, the calibration marks 40 are positioned with amaximum displacement between the calibration marks. As a result, thecalibration marks can be positioned in opposing corners of the template18 as illustrated in FIG. 1G.

As illustrated in FIG. 1H, the writing surface 28 can also include abackground image 50 which is either printed onto the writing surface orpositioned over the writing surface. Alternatively, the background image50 can be projected onto the writing surface. Since the writing surfacecan be constructed from transparent materials such as glass or plastic,the background image 50 can be projected onto the surface from eitherbehind or in front of the writing surface. Suitable forms for thebackground image 50 include, but are not limited to, a spreadsheet asillustrated in FIG. 1H, blueprints, handwritten or typewritten text,notes, graphs, graphics, etc. The background image 50 can be placed on amaterial which is physically attached to surface and used as the writingsurface. Examples of materials on which a background image 50 may appearinclude paper, plastic sheets and other materials which can be writtenupon. The background image 50 can also be an image which is projectedonto a writing surface 28. For instance, the background image 50 can bean image projected onto the writing surface 28 from a front or rearprojection system (e.g., a reflective or transmissive display).

As illustrated in FIG. 1H, when a background image 50 is used on thewriting surface 28, writing on the writing surface in combination withthe background image 50 forms a composite image 52 which appears on themonitor 22. The system can be calibrated so strokes written on thewriting surface 28 are properly positioned relative to the backgroundimage 50 in the composite image 52 that is formed. For instance, whenthe background image 50 includes an image of a spreadsheet, an imagewritten into a particular cell of the background image 50 appears in thesame cells on the composite image 52 as illustrated in FIG. 1H.

The background image 50 and the image upon the background image 50 canbe created with the processing unit 20, monitor 22 and user interface24. For instance, the image for the background image 50 can be aspreadsheet created with a program such as EXCEL. Other images for thebackground image 50 can be created with graphics programs such as VISIO,CAD programs, or other programs used to make documents. The image forthe background image 50 can also be externally created. For instance,the image for the background image 50 can be blueprints which arescanned into the processing unit 20 via a scanner.

The system can include logic for converting the image for the backgroundimage 50 to an Image file. During conversion to the Image file, thelogic adds calibration marks 40 to the image for the background image50. The Image file can then be printed on a conventional printer or on aprinter which can print enlarged size sheets.

The background image 50 can be printed on paper or on a transparencysuitable for projection from an overhead. A printed background image 50can also be converted to a form suitable for projection such as atransparency for an overhead projector or a slide for a slide projector.

Once the background image 50 is positioned on the writing surface, abackground image calibration may be required in order to determine theposition of the background image 50 relative to the detectors 12A, 12B.To initiate the background image calibration, the user notifies thesystem that a particular background image 50 will be used in combinationwith a writing surface 28. Once the system is notified, the user isprompted to contact the stylus with one or more calibration marks 40having a predetermined physical relationship to the background image 50.Contacting the calibration marks 40 with the stylus serves to identifythe position of the background image 50 relative to the detectors 12A,12B. Because the position of the stylus is also measured relative to thedetectors, contacting the calibration marks 40 with the stylus permits adetermination of the position of the stylus 10 relative to thebackground image.

In one embodiment of using a background image, illustrated in FIG. 1I, abackground image 50, such as an image from a webpage is projected onto awriting surface 28 (illustrated as a rear projection). Writing 54, suchas comments or modifications to the projected background image, are maderelating to the projected background image by writing on the writingsurface 28, thereby forming a composite image comprising the projectedbackground image 50 and the writing 54. The composite image 52 of theprojected background image 50 and the writing made on the writingsurface can be displayed on a monitor 22, stored into memory, and/orprojected in another location. As can be seen from this embodiment, avariety of composite images can be formed which allow for a dynamicrange of graphic presentations to one or more remote locations.

System Variations

In general, the transcription system records the written image 44 bydetecting the position of the stylus 10 on the writing surface 28 atmultiple times, each position detected serving to form a point on themonitor image 34. By detecting the position of the stylus 10 at asampling rate that is fast relative to the speed with which the stylus10 is moved during writing, an image 34 corresponding to what has beenwritten can be recorded and displayed in real time. As will be describedin detail below, each point is determined based on the time that ittakes for a position signal to travel between the stylus 10 and thefirst and second detectors 12A, 12B. This time is called the positionsignal's time of flight.

Several different system designs may be employed in order to determine aposition signal's time of flight between the stylus 10 and the first andsecond detectors 12A, 12B. Several of these different system designs aredescribed with regard to FIGS. 2A-2D. It is noted however thatadditional system configurations may also be envisioned and are intendedto fall within the scope of the present invention.

FIG. 2A illustrates an embodiment where the stylus 10 includes at leastone reference signal receiver 56 and a position signal transmitter 58.Meanwhile, the first detector 12A and the second detector 12B eachinclude a position signal receiver 60. Located somewhere in the systemis a reference signal transmitter 62. In FIG. 2A, the reference signaltransmitter 62 is included in the second detector 12B. In otherembodiments, the reference signal transmitter 62 can be included in thehardware unit 14.

As illustrated in FIG. 2A, a reference signal 64 is transmitted to thestylus 10. Receipt of the reference signal 64 by the stylus 10 triggersthe stylus 10 to transmit a position signal 66. The position signal 66is propagated radially from the stylus 10 and received by the firstdetector 12A and the second detector 12B at a time that is dependent onthe distance between the stylus 10 and each of the first detector 12Aand the second detector 12B at the time that the position signal 66 isproduced. Since the position signal 66 is transmitted at a known timeafter the reference signal 64 is transmitted, the time of flight of theposition signal 66 to the first and second detectors 12A, 12B can bedetermined.

The hardware unit 14 receives position signals 66 from the first andsecond detectors 12A, 12B and controls the transmission of the referencesignals 64 from the reference signal transmitter 62. The hardware unit14 uses the received position signals 66 to determine the time of flightof the position signal 66 from the stylus 10 to the first detector 12Aand the second detector 12B. The time of flight is received by theprocessing unit 20 which includes logic for using the time of flightdata to determine the position of the stylus 10 relative to the firstdetector 12A and the second detector 12B. The logic may employ a varietyof methodologies for determining the position of the stylus 10including, for example, triangulation or a look-up table containingdifferent positions associated with different times of flight to thefirst and second detectors 12A, 12B.

A variety of reference signals 64 may be used. In general, the referencesignal 64 should be at least as fast as the position signal 66 and ispreferably significantly faster than the position signal 66. When thereference signal 64 is significantly faster than the position signal 66(e.g., speed of light vs. speed of sound), it is possible to disregardthe time of flight of the reference signal 64 when determining the timeof flight of the position signal 66. In one embodiment, the referencesignal 64 travels at the speed of sound and in another travels at thespeed of light. In a particular embodiment, the reference signal 64 is aform of electromagnetic radiation, such as an infra-red (IR) or radiofrequency (RF) signal. The position signal may also be ultrasound.

A variety of position signals 66 may be used. In one embodiment, theposition signal 66 is ultrasound. In another embodiment, the positionsignal 66 is a form of electromagnetic radiation, preferablymicro-impulse radar which yields an effective time of flight forelectromagnetic signals.

FIG. 2B illustrates an alternative embodiment where the stylus 10includes a position signal transmitter 58 and is physically attached tothe hardware unit 14 by a wire 68. Meanwhile, the first detector 12A andthe second detector 12B each include a position signal receiver 60.

As illustrated in FIG. 2B, a reference signal 64 is transmitted to thestylus 10 from the hardware unit 14 via the wire 68. When the referencesignal 64 is received, the stylus 10 transmits a position signal 66which propagates radially from the stylus 10 and is received by thefirst detector 12A and the second detector 12B at a time that isdependent on the distance between the stylus 10 and the first detector12A and the second detector 12B at the time that the position signal 66is produced. Since the position signal 66 is transmitted at a known timeafter the reference signal 64 is transmitted, the time of flight of theposition signal 66 to the first and second detectors 12A, 12B can bedetermined.

FIG. 2C illustrates an alternative embodiment where the stylus 10includes a position signal transmitter 58 and the first detector 12A andthe second detector 12B each include position signal receivers 60. Thestylus 10 also includes a reference signal transmitter 62 and the seconddetector 12B includes a reference signal receiver 56 in addition to theposition signal receiver 60.

As illustrated in FIG. 2C, a reference signal 64 is transmitted by thestylus 10 to the second detector 12B to signal that a position signal 66is being transmitted or is about to be transmitted. The position signal66 is received by the first detector 12A and the second detector 12B.Since the position signal 66 is transmitted at a known time after thereference signal 64 is transmitted, the time of flight of the positionsignal 66 to the first and second detectors 12A, 12B can be determinedby the processing unit 20.

In the embodiment illustrated in FIG. 2C, the reference signal 64 andthe position signal 66 can be transmitted together for each point in themonitor image 34. However, the position signal 66 can also betransmitted without the reference signal 64. For instance, the referencesignal 64 can serve to synchronize the timing of the stylus 10 and thehardware housing and/or the processing unit 20. When the referencesignal 64 serves as a synchronizing signal, the stylus 10 is configuredto transmit a series of position signals 66 at a known time interval.The reference signal 64 indicates when the first position signal 66 inthe series is transmitted. The hardware unit 14 includes a timer whichis started after receiving the reference signal 64. The first time offlight determination for a particular detector is made by measuring thetime between starting the timer and receiving the position signal 66 atthe particular detector. Since subsequent position signals 66 aretransmitted at known intervals, the hardware housing and/or theprocessing unit 20 can include logic for determining when eachsubsequent position signal 66 is transmitted. As a result, the time offlight to a particular detector can be calculated by determining thetime between when the position signal 66 is transmitted and when theposition signal 66 is received at that detector without each time offlight needing a reference signal to obtain the measurement.

FIG. 2D illustrates yet another embodiment where the stylus 10 includesa position signal receiver 60 and a reference signal transmitter 62. Thefirst detector 12A and the second detector 12B include position signaltransmitters 58 and reference signal receivers 56. It is noted that thisembodiment can be readily varied where the stylus 10 includes areference signal receiver 56 and one or both of the first detector 12Aand the second detector 12B include a reference signal transmitter 62.

As illustrated in FIG. 2D, the first and second detectors 12A, 12Btransmit different position signals 66 which can be distinguished by theposition signal receiver(s) 60 on the stylus 10. When the stylus 10receives one or more of the position signals 66, the stylus 10 transmitsa reference signal 64 to confirm receipt of the position signal 66 andrequest that the next position signals 66 be sent.

System Variations Relating To Calibration

The systems described above may require calibration. For example, it maybe necessary to determine a separation between detectors, a dimension ofthe writing area, a temperature adjacent the writing surface, a positionof a template relative to a writing surface, and/or a position of abackground image positioned on, printed on, or projected on a writingsurface.

The displacement, L, between first and second detectors can bedetermined. The dimension of the writing area 38 can also be determinedduring calibration. For instance, the writing area height, H, writingarea width, W, and writing area diagonal, D, are some of the dimensionswhich can be determined during calibration. Each of these dimensions areillustrated in FIG. 3A. The position of the template 18 and each of thecontrol sections 32 can also be determined during the calibration of thesystem. Different embodiments of the transcription system require thatdifferent combinations of these variables or none of these variables bedetermined during calibration.

FIG. 3B illustrates an embodiment which can automatically determine thefirst and second detector displacement, L. The first detector 12Aincludes a reference signal receiver 56 and a position signaltransceiver 70. Examples of suitable position signal transceivers 70include, but are not limited to, PZT, PVDF, electrostatic andpiezoelectric or piezoceramic ultrasonic transceivers.

During calibration of the system, a reference signal 64 transmitted froma reference signal transmitter 62 included in the second detector 12B isreceived at the reference signal receiver 56 included in the firstdetector 12A. In response, a position signal 66 is transmitted from theposition signal transceiver 70 in the first detector 12A. The positionsignal 66 is received by the position signal receiver 60 of the seconddetector 12B. The time of flight of the position signal 66 between thefirst and second detectors 12A, 12B can be multiplied by the speed ofsound to determine L. When the system is not being calibrated, theposition signal transceiver 70 works as a position signal receiver 60.In another embodiment, the position signal transceiver 70 can bereplaced with a position signal transmitter 58 and an independentposition signal receiver 60.

FIG. 3C illustrates another embodiment including features for systemcalibration. The first detector 12A includes a calibration mark 40.During calibration, the user is prompted by the computer to contact thestylus 10 within the calibration mark 40. Upon contact of the stylus 10with the calibration mark 40, the stylus transmits a position signal 66.The position signal 66 is received at the position signal receiver 60included in the second detector 12B. The time of flight of the positionsignal 66 between the first and second detectors 12A, 12B is multipliedby the speed of sound to determine the first and second detectordisplacement, L.

As discussed above, the processing unit 20 may optionally produce animage on the monitor 22 to guide the user through the calibration. Forinstance, the processing unit 20 can create an image 42 of a stylus 10contacting the calibration mark 40 on an image of the first detector12A. In response, the user can contact the stylus 10 with thecalibration mark 40 of the first detector 12A as illustrated. The usercan also be prompted to contact the stylus 10 to the calibration marks40 by commands on the monitor 22 through feedback obtained from amulti-media computer. For instance, "Touch stylus to left detector." canappear on the monitor 22. The command can also take the form of anaudible message.

The first and second detectors can be included in a detector assembly 72as illustrated in FIG. 3D. The detector assembly 72 includes a couplingmember 74 attached to each of the first and second detectors 12A, 12B.The coupling member 74 keeps the first and second detectors 12A, 12B ata known displacement. As a result, the first and second detectordisplacement, L, is a known constant which does not need to bedetermined during the calibration.

As illustrated in FIG. 3E the detector assembly 72 can be positionedalong the side of the writing area 38. This arrangement of the first andsecond detectors 12A, 12B can be advantageous as it keeps the wires ononly one side of the writing surface 28 rather than needing to be guidedaround the periphery of both sides of the writing surface 28. Further,the first and/or second detectors 12A, 12B can be designed to receiveposition signals 66 from a 180 degree range of directions called thereception range. The 180 degree reception range allows the writing areawidth, W, and the writing area height, H, to extend beyond the first andsecond detector displacement, L.

As also illustrated in FIG. 3E, the position of the template 32 relativeto the detector assembly can be determined by the system by contactingtwo different locations of the template (dark boxes) whose locationrelative to the overall template 32 is known by the system.

In another embodiment, the system calibrates itself to correct for theeffect of temperature changes on the speed of ultrasound signals in thetranscription system. Temperature sensors may optionally be incorporatedinto the stylus, template and/or positioned adjacent one or more of thedetectors. According to this embodiment, the temperature adjacent thewriting surface is periodically measured and the time of flightcalculations are adjusted in view of the measured ambient temperature.By performing this type of calibration periodically, changes intemperature conditions, for example due to whether sunlight is impactingupon the writing surface, can be addressed.

The Stylus

One or more styluses may be used with the transcription system. FIG. 4Aillustrates an embodiment of a stylus 10 which can be used with thetranscription system illustrated in FIG. 2A. As illustrated, the stylus10 includes a stylus housing 76 and a writing element 78. Examples ofsuitable writing elements 78 include, but are not limited to, aninkwell, chalk, pencil, pencil lead, pen and a marker such as a SANFORDEXPO. The stylus housing 76 includes a tip end 80 with a position signaltransmitter 58 adjacent the end. The stylus housing 76 as illustratedalso includes activation electronics 82, implement electronics 104, anda plurality of reference signal receivers 56. The stylus housing 76 isalso capable of housing a power source 84 which is preferably removablyattachable to the stylus.

In FIGS. 2A, 2C and 2D, the reference signal transmitters 62 orreference signal receivers 56 are illustrated as being positioned at anupper end of the stylus, however, the reference signal transmitters 62or reference signal receivers 56 can be positioned at the tip end 80 ofthe stylus 10 as illustrated in FIG. 4A. Reference signal transmitters62 or reference signal receivers 56 can also be included as a ring ofpiezoelectric material 86 extending around the circumference of thestylus 10. The ring of material can be constructed from any materialknown to transmit the reference signal.

As illustrated in FIG. 4B, the stylus housing 76 may be designed suchthat the writing element 78 is removable from the stylus housing 76. Asillustrated, the stylus housing 76 may include a removable member 88which is attachable and detachable to an end of a sleeve 90. Asillustrated, sleeve 90 defines a volume 92 within which the writingelement 78 may be positioned and the removable member 88 serves tomaintain the writing element 78 within the sleeve 90. When the writinginstrument is replaced, the tip 94 of the replacement writing instrumentis inserted through the stylus housing 76 and into the tip end 80 of thestylus 10. The removable member 88 is placed on the stylus 10 so therear 96 of the writing instrument is in contact with the activationelectronics 82.

As illustrated in FIG. 4C, the stylus housing 76 may include a firstmember 98A which is attachable and detachable to a side of a secondmember 98B. Detaching the first member 98A from the side of the secondmember 98B provides easy access to the writing element 78 and the powersource 84. By enabling the writing element 78 to be readily removable,the writing element 78 can be replaced when writing media contained inthe element is exhausted or a different writing media (type or color) isdesired. Similarly, enabling the power source 84 to be readily removablepermits the power source 84 to be replaced when the power begins to runlow.

As illustrated in FIGS. 4C and 4D, the stylus housing 76 may include anaperture 100 which allows a user to rotate the writing element 78 aboutits longitudinal axis without having to open or otherwise disassemblethe stylus housing 76 and without having to remove the writing element78 from the stylus housing 76. As illustrated, some writing elementsinclude a tip which is not symmetrical about the longitudinal axis ofthe writing element, such as a wedge shaped tip of a marker. In suchinstances, it may be desirable to periodically alter the angularpositioning of the tip of the writing element relative to the stylushousing 76. This may be accomplished in this embodiment by rotating thewriting element while it is in the housing through the aperture 100without having to remove or disassemble the stylus.

As also illustrated in FIG. 4A, the stylus housing 76 may optionallyinclude a sensor 102 adjacent the end of the stylus housing 76 out ofwhich the writing element 78 extends which serves to detect if thewriting element 78 is out of writing media. For example, the sensor maybe used to detect a water content or another solvent content of theportion of the writing element extending from the housing, therebyalerting a user when the writing element is out of ink or has dried outand needs to be replaced. An example of a sensor is a pair of contactspositioned at the end of the stylus housing. In operation, a current canbe passed through the tip of the writing element. The tip of certainwriting element will conduct varying amounts of current depending on theamount of writing media which remains within the stylus. Accordingly,the stylus can include logic for monitoring the current through the tipto identify the amount of media remaining in the writing element. Whenthe sensor detects that the amount of media is below a threshold, thestylus can provide a low media signal encoded into a reference signal ora position signal. Upon detecting the low media signal the hardware unitcan activate a particular indicator or can provide a second low mediasignal to the processing unit which can respond accordingly.

It is preferred that at least a portion of the stylus housing 76 isclear or opaque such that it is possible to see the writing element 78within the housing. This allows the user to observe the color of thewriting element 78 without having to open the housing or remove thewriting element 78. In certain instances, for example when chalk,graphite or a liquid ink reservoir is used in conjunction with thewriting element, it is possible to observe how much writing media isremaining.

The activation electronics 82 can include a contact switch whichindicates when the stylus 10 is being used to write. The contact witchtypically works based on pressure being exerted between the stylus 10and a writing surface 28. In operation, the stylus 10 is held such thatthe tip 94 of the writing instrument is contacted with the writingsurface 28. The pressure of the writing instrument on the writingsurface 28 closes the contact switch to activate a circuit within theimplement electronics 104.

When the circuit within the stylus housing 76 is activated, anactivation signal is provided to the system to indicate that the stylus10 has been contacted with the writing surface 28. The propagation ofreference and position signals 66 can be initiated in response to theactivation signal. The activation signal may be a position signal 66 ora reference signal 64 transmitted from the stylus 10. Similarly, whenthe implement electronics 104 is deactivated by lifting the stylus 10off the writing surface 28, a deactivation signal may be transmitted tothe system. The system can also detect when the implement electronics104 has been deactivated by detecting that a position signal 66, orreference signal 64, has not been transmitted from the stylus 10 forsome predetermined period of time.

The activation electronics 82 can optionally include a pressure sensorwhich measures the pressure exerted between the stylus 10 and thewriting surface 28 called the exerted pressure. Examples of pressuresensors which may be used include, but are not limited to strainsensors, piezoelectric elements or linear resistive strips. Theactivation electronics 82 can produce a signal indicating the exertedpressure. The signal can be received within the implement electronics104 and can serve to activate the implement electronics 104. Theimplement electronics 104 can include logic for encoding a pressuresignal which indicates the degree of exerted pressure into a referencesignal 64 or a position signal 66 transmitted from the stylus 10.Whether the pressure signal is encoded into the reference signal 64 orthe position signal 66 depends on whether the stylus 10 includes aposition signal transmitter 58, a reference signal transmitter 62, orboth.

Additional signals can be encoded into position signals or referencesignals by varying the characteristics of the signal. For instance, toencode an additional signal into a reference signal, the value of theadditional signal can be digitized and sent as a series of bits in thereference signal. To encode an additional signal into a position signal,the position signal can be transmitted with varying frequencies ordurations which are a function of the additional signal value.

The pressure signal can be received by the hardware unit 14 or theprocessing unit 20. The hardware unit 14 or the processing unit 20 caninclude logic which can identify the pressure signal and interpret thepressure signal to determine the amount of pressure being exerted on thestylus 10. The hardware unit 14 or the processing unit 20 can alsoinclude logic for adjusting the width of each stroke on the monitorimage 34 in response to the exerted pressure. For instance, when thepressure signal indicates that large pressure is being exerted, thewidth of the stroke on the monitor image 34 can be increased and whenthe exerted pressure is low, the width of the stroke on the monitorimage 34 can be decreased. As a result, the monitor image 34 is createdto more closely resemble the written image 44.

The implement electronics 104 can also optionally include a powermonitoring device which monitors the amount of power remaining in thepower source 84. Examples of power measuring devices which may be usedinclude, standard power monitoring circuits and can be included in somemicrocontrollers. When the available power falls below a thresholdlevel, a power signal can be encoded into a reference signal 64 or aposition signal 66 transmitted from the stylus 10. The power signal canbe received by the hardware unit 14 or the processing unit 20. Thehardware unit 14 or the processing unit 20 can include logic which canidentify the power signal. Once the power signal has been identified,the user can be notified of the low power status by a message on themonitor 22 or by an indicator on the hardware unit 14. An example of anindicator (not shown) on the hardware unit 14 may be an LED whichflashes once the power signal has been received.

The implement electronics 104 can also include logic for producing anidentifier signal which is unique to the type of the stylus 10 beingused. The identity signal can be encoded into a reference signal 64 or aposition signal 66 transmitted from the stylus 10. The hardware unit 14or the processing unit 20 can include logic which can identify theidentity signal and interpret the identity signal to determine the typeand accordingly the characteristics of the stylus 10 from the identitysignal. The characteristics of the stylus can include color, line,width, and line pattern.

The identifier signal can be transmitted when the implement electronics104 are first activated or each stylus 10 can constantly transmitsignals which are unique to that particular type of stylus 10. Theidentifier signal can be received within the hardware unit 14 or theprocessing unit 20 and used to identify the particular stylus 10 beingused to write upon the writing area 38. Once the stylus 10 has beenidentified, the monitor image 34 is created with characteristics whichcorrelate to the identified stylus 10. For instance, the stroke on themonitor image 34 can have a color matching the color of the stylus 10being used to write on the writing surface 28 can have a stroke widthmatched to the width of the stylus 10.

When the stylus transmits an identifier signal which is identified witha particular color, the stylus housing 76 can include a visibleidentifier which indicates to a user the color of the strokes which willappear on the monitor image 34 when that stylus 10 is used. Forinstance, the stylus housing can be 50% transparent and 50% red in colorto indicate that use of the stylus will cause red colored strokes toappear on the monitor. Of course, the transcription system can includelogic for changing the color of a stroke on the monitor after the strokehas been made.

When the stylus transmits an identifier signal which is identified witha particular characteristics, the stylus housing 76 can be designed soit will accept only writing implements with the particularcharacteristics. For instance, if a stylus housing transmits an identitysignal which is identified with the color red, the stylus housing andwriting implements can be designed so the stylus housing will not acceptwriting implements which are not red. One method for achieving thiscorrelation of stylus housings with writing implements is to design thewriting implements with particular characteristics so the writingimplements have a geometry which is unique to the particularcharacteristics. For instance, blue writing implements can have a uniquelength, unique diameter or unique cross sectional shape such as round,hexagonal, octagonal, oval, etc. The stylus housings 76 which acceptwriting implements with particular characteristics can have sleevesdefining volumes 92 which are complementary to the unique writingimplement geometry. For instance, if blue pens have a hexagonal crosssection, the volume 92 within the correlated stylus housing can have ahexagonal cross section.

The implement electronics 104 can also include logic for responding toinquiry signals from the hardware unit 14 or the processing unit 20. Theinquiry signal can be coded into a reference signal 64 which istransmitted from a first or second detector 12A or 12B. The stylus 10receives the reference signal 64 and logic within the implementelectronics 104 recognizes the inquiry signal. The logic can alsointerpret the inquiry signal as inquiring whether the stylus 10 is aparticular type of stylus 10. The logic in the implement electronics cancause the position signal 66 to be withheld or transmitted based onwhether the stylus 10 matches the type of stylus inquired about. Thehardware unit 14 or the processing unit 20 can include logic forinterpreting the transmission or lack of transmission of the positionsignal 66.

As also illustrated in FIG. 4A, the stylus 10 includes reference signalreceivers 56. These receivers are preferably evenly spaced around thestylus 10 so that reference signals 64 can be received from any anglerelative to the stylus 10. In a preferred embodiment, the referencesignal receiver 56 is an IR signal receiver. An example of an IRreceiver that may be used includes, but is not limited to, a photodiode. The reference signal 64 can also be an RF signal.

As also illustrated in FIG. 4A, the stylus 10 includes a position signaltransmitter 58. In one embodiment, the position signal transmitter 58 isan ultrasound transmitter. Examples of ultrasound transmitters that maybe used include, but are not limited to, Polaroid L Series ultrasonicemitters, cylindrical polyvinylidene fluoride (PVDF) rings and similarpiezotransducing elements. An example of a position signal 66 includes,but is not limited to, a 40 kHz signal emitted for approximately 0.7 ms.

FIG. 4C illustrates an embodiment of the stylus 10 which can be usedwith the transcription system illustrated in FIG. 2B. The implementelectronics 104 is coupled to the system via an electrical wire 68. As aresult, the reference signal 64 can be transmitted to the stylus 10 viathe wire 68. The position signal 66 is transmitted from the positionsignal transmitter 58 in response to receiving the reference signal 64.

The stylus 10 can also be adapted to be used in a transcription systemsuch as the one illustrated in FIG. 2C. For example, the stylus 10 caninclude a reference signal transmitter 62 and a position signaltransmitter 58. The detectors 12A, 12B can be modified to include areference signal receiver 56 and a position signal receiver 60.

The stylus 10 can also be adapted to be used in a transcription systemsuch as the one illustrated in FIG. 2D. For example, the stylus 10 caninclude a reference signal transmitter 62 and a position signal receiver60. The detectors 12A, 12B can be modified to include a position signaltransmitter 58. A reference signal receiver 56 is also provided in thesystem and may optionally be incorporated into one of the detectors 12A,12B.

The stylus can include a cap for covering a portion of the writingelement which extends outside of an end of the stylus housing and isused to write upon a writing surface. The cap may optionally be clear inorder to allow the user to observe the color of the writing elementwithout having to remove the cap. The cap may also optionally be sizedto fit over a position signal transmitter or position signal receiverpositioned adjacent an end of the stylus housing out of which thewriting element extends. The stylus housing may optionally include a capholding mechanism to which the cap may be attached when the stylus is inuse.

An example of a stylus cap is illustrated in FIG. 4D. The cap 106 isconfigured to be coupled with the stylus 10 as illustrated in FIGS. 4Cand 4E. The cap 106 can also configured to be coupled with a back endthe stylus as illustrated in FIG. 4D. Accordingly, during operation ofthe stylus, the cap 106 can be stored on the back of the stylus in orderto prevent loss of the cap 106. The cap 106 can serve to protect the tipof the stylus 10 or the writing element 78 when the stylus 10 is not inuse. The cap can also serve to prevent certain types of writing elements78, such as markers, from drying out from exposure to air.

FIG. 4F is a cross section of the stylus housing 76 coupled with thecap. The cap 106 includes a position signal transmitter/receiveraccommodation area 108. The position signal transmitter/receiveraccommodation area 108 has a volume which is sufficient for a positionsignal transmitter 58 or a position signal receiver 60 to fit within thecap without being in contact with the cap 106. As a result, the positionsignal transmitter/receiver accommodation area 108 serves to protect theposition signal transmitter 58 or position signal receiver 60 when thecap is coupled with the stylus housing 76.

The cap 106 may include stylus contact points 110 as illustrated in FIG.4F and 4G. The stylus contact points 110 are in contact the stylushousing 76 when the cap 106 is coupled with the stylus housing 76. Thestylus contact points 110 limit the distance that the cap 106 can bepushed onto the stylus housing 76 to prevent damage to the stylus 10and/or the writing element 78.

As illustrated in FIG. 4G, the stylus contact points 110 can contact thetip end 80. When the stylus contact points 110 contact the tip end 80,the volume of the position signal transmitter/receiver accommodationarea 108 is reduced. Reducing the volume also reduces the amount of airwithin the position signal transmitter/receiver accommodation area 108.As a result, the amount of moisture which can be withdrawn from certainwriting elements 78 is reduced also reducing the opportunity for certainwriting elements 78 to become dried out.

A variety of mechanisms can be utilized for removably attaching thestylus cap to the housing. For example, the cap may include a grippingsleeve section 112 which contacts the stylus housing 76. The grippingsleeve section 112 has enough length that the friction between thegripping sleeve section 112 and the stylus housing 76 keeps the cap 106in place on the stylus 10.

As illustrated in FIG. 4H, the stylus housing 76 can include a stylusridge 116 and the cap 106 can include a cap ridge 114. The diameter ofthe cap ridge 114 is smaller than the diameter of the stylus ridge andthe cap 106 is constructed from a flexible materials which pen andmarker caps are traditionally constructed from. When the cap 106 ispushed onto the stylus 10, the diameters of the cap ridge 114 and thestylus ridge 116 prevent the cap 106 from sliding on. However, whensufficient pressure is applied to the cap 106, the cap 106 deformsenough for the cap ridge 114 to slide past the stylus ridge 116. In thisposition, pressure is also required to remove the cap 106 from thestylus 10. As a result, the cap 106 remains in place on the stylus 10until the user applies the pressure necessary to remove the cap 106.

The above cap embodiments are advantageous because traditional capdesigns frequently rely on friction between the stylus neck 118 and thecap 106 to keep the cap 106 in place. However, such a cap design coulddamage a position signal transmitter 58 positioned on the stylus neck118. Further, traditional caps do not include the volume required toaccommodate the position signal transmitter 58.

FIGS. 4K and 4L illustrate further alternative embodiments of stylusesthat may be used with the system of the present invention. Thesestyluses are designed to be used with a removeable, disposable writingelement which includes its own power source for powering the operationof the stylus. These embodiments obviate the need for a separate powersource 84 and a separate space in the stylus housing for a power source85, as shown in FIG. 4C. This allows the stylus design to be madesmaller and more ergonomic. In particular, as can be seen in FIGS. 4Kand 4L, the styluses have a narrower design which allows the styluses tobetter approximate the size and feel of a standard whiteboard marker.

FIG. 4K illustrates a stylus embodiment where the stylus electronics arepositioned toward a distal end of the stylus adjacent the tip. Asillustrated, the stylus includes a housing comprised of a proximal body111, a distal body 113. A removeable, disposable writing element 115 issized to fit within the stylus housing. The writing element 115 includesa power source 117 and power source contacts 119.

Included on the proximal body 111 is an exterior pen housing 121 whichis preferably clear to show the color of the writing element being used.Also included on the proximal body 111 is a groove 123 for holding thestylus cap. Power source contacts and electrical traces (not shown) arealso included in the proximal body 111 for delivering power from thepower source 117 on the writing element 115 to electronics on the distalhousing body 113.

Included on the distal body 113 is a piercing element 125 for deliveringwriting media from the writing element 115 to a stylus tip 127. It isnoted that the distal body 113 may optionally include a bore (not shown)through which a writing tip from the writing element 115 can pass and bepositioned where the stylus tip 127 is shown. Also included in thedistal body is a signal transmitter 129, preferably a transducer,electronics 131 for operating the stylus, and threading 133 forconnecting the proximal body 111 to the distal body 113. As alsoillustrated, a cap 135 is provided which is sized to fit over the stylustip 127 and the signal transmitter 129.

FIG. 4L illustrates a stylus embodiment where an elongated writingelement is employed which allows the diameter of the stylus to befurther reduced. As illustrated, the stylus includes a housing 137 witha bore 139 through a middle of the housing. An elongated removeable,disposable writing element 141 is sized to fit within the bore 139 inthe stylus housing 139. The writing element 141 includes a power source143 and power source contacts 145. The stylus housing 137 also includescontacts 147 which are positioned to contact the power source contacts145. Also included on the stylus housing is a stylus tip 149, a signaltransmitter 151, preferably a transducer, and electronics 153 foroperating the stylus. It is noted that the housing 139 may optionallyinclude a bore (not shown) through which a writing tip from the writingelement 141 can pass and be positioned where the stylus tip 149 isshown. As also illustrated, a cap 155 is provided which is sized to fitover the stylus tip 149 and the signal transmitter 151.

The Eraser

FIG. 5A illustrates an eraser 16 which may be used in a system accordingto the present invention. The eraser 16 illustrated includes a holdingsurface 120, an eraser pad 122, a position signal transmitter 58, areference signal receiver 56, activation electronics 82 and implementelectronics 104. It is noted that this eraser 16 is designed for use ina transcription system such as the one illustrated in FIG. 2A. However,the eraser 16 can be modified, as described above with regard to thestylus 10, for use with different transcription systems.

In operation, the eraser 16 is positioned such that the eraser pad 122is pushed against the writing surface 28. The eraser pad 122 isconstructed from a material which erases the writing element media fromthe writing surface 28. For instance, when the writing element 78 is awhite board marker, the eraser pad 122 can be a typical white boarderaser material. As a result, contact between the eraser pad 122 and thewriting surface 28 can serve to erase a portion of the writing imagefrom the writing area 38.

The activation electronics 82 on the eraser 16 can include a contactswitch. The pressure of the eraser pad 122 on the writing surface 28drives the eraser pad 122 against the contact switch closing the contactswitch and activating a circuit within the implement electronics 104.Activating the implement electronics 104 can serve to signal theeraser's 16 operation to the hardware unit 14 and/or the processing unit20 in a similar manner as discussed with respect to the stylus 10.

When the implement electronics 104 are activated, a reference signal 64received at one of the reference signal receivers 56 triggers a positionsignal 66 to be transmitted from the position signal transmitter 58. Thereference signal receivers 56 are preferably evenly spaced around theeraser 16 so a reference signal 64 can be received from different anglesaround the eraser 16. The reference signal receivers 56 and the positionsignal transmitter 58 can be similar to the reference signal receivers56 and the position signal transmitter 58 used in the stylus 10.

The signal transmitted by the position signal transmitter 58 on theeraser 16 can optionally be different from the signal transmitted by theposition signal transmitter 58 on the stylus 10. The hardware unit 14and/or the processing unit 20 can then distinguish that the signal beingreceived is from the eraser 16 as opposed to the stylus 10. When thetranscription system detects that it is receiving signals from theeraser 16, the transcription system erases the monitor image 34according to the position of the eraser 16 on the writing surface 28.

The processing unit 20 detects the position of the position signaltransmitter 58 on the eraser 16. However, the portion of the writtenimage 44 which is erased is the portion of the written image 44 incontact with any portion of the eraser pad 122 and not simply theposition of the position signal transmitter 58. Accordingly, theprocessing unit 20 includes logic which accounts for the portion of thewritten image 44 actually contacted by the eraser pad 122. Theprocessing unit 20 can be used to calculate an approximate eraser area124 which matches the eraser pad footprint 126 as illustrated in FIG.5B. As the eraser 16 is moved about the writing surface 28, the portionof the monitor image 34 which falls within the approximate eraser area124 is erased from the monitor image 34. The size of the approximateeraser area 124 can be adjusted so it matches the actual size of theeraser pad footprint 126. Similarly, the approximate eraser area 124 canbe calculated to have different shapes which match the shape of theeraser pad footprint 126.

The activation electronics 82 and the implement electronics 104 in theeraser 16 can perform many of the same functions as the activationelectronics 82 and the implement electronics 104 in the stylus 10 inaddition to the functions described above. For instance, the implementelectronics 104 can include logic for transmitting an identity signaland/or low pressure signals encoded into a reference signal. Further,the implement electronics 104 can include logic for responding or notresponding to inquiry signals encoded into reference signals 64.

As illustrated, the eraser pad 122 may be sized to be a little smallerthan the perimeter of the eraser. This sizing of the eraser pad 122serves to prevent the user from using an edge of the eraser to erasewith since erasing using an edge of the eraser may not cause the contactswitch on the eraser to be depressed and erasing movement to bedetected. This sizing of the eraser pad thus forces the user to placethe eraser pad surface parallel to the writing surface in order toerase.

Detectors

FIG. 6A illustrates an embodiment of a detector 12B which may be usedwith the transcription system illustrated in FIG. 2A. The detector 12Bincludes a detector housing 128, detector electronics 130 and a positionsignal receiver 60 and a reference signal transmitter 62. The referencesignal transmitter 62 is preferably positioned in an upper surface 132of the detector housing 128. An example of an ultrasound receiver thatmay be used is the Polaroid L Series Ultrasonic Receiver. An example ofa reference signal transmitter 62 that may be used is an IR transmittersuch as an photo diode or an RF transmitter such as an FM transmitter.The position signal receiver 60 may be coupled to the hardware unit 14through a wire 68 connection (or a wireless connection) in order tocommunicate to the hardware unit 14 when position signals 66 arereceived by the detector 12B.

As illustrated in FIG. 6B, a lower surface 134 of the detector housing128 includes one or more attachment mechanisms 136 for removablyattaching the detector housing 128 to the writing surface 28. Examplesof suitable attachments mechanisms include, but are not limited to,suction cups, magnets, VELCRO or a refreshable contact cement. It isalso envisioned that mounting brackets may also be attached to thewriting surface 28 which may obviate the need for an attachmentmechanism.

The detector 12B can be converted to detector 12A for use with thesystem of FIG. 2A by removing the reference signal transmitter 62. Thedetector 12B may also be adapted for use with the transcription systemof FIG. 2B by removing the reference signal transmitter 62.

The detector 12B may also be adapted for use with the transcriptionsystem of FIG. 2C by replacing the reference signal transmitter 62 witha reference signal receiver 56. Examples of reference signal receivers56 that may be used include, but are not limited to, a photo diode.

The detector 12B may also be adapted for use with the transcriptionsystem of FIG. 2D by replacing the reference signal transmitter 62 witha reference signal receiver 56 and by replacing the position signalreceiver 60 with a position signal transmitter 58.

FIG. 7A illustrates another embodiment of detectors 12A, 12B that may beemployed. The first or second detector 12A, 12B includes a reflectingsurface 138 attached to a frame 140 which may serve as a shieldingelement. The reflecting surface 138 has a parabola shaped profile. Theparabola is rotated 180 degrees about the parabola's focus to give thereflecting surface 138 a semi-circular footprint 142. The reflectingsurface 138 can be constructed from any material which will reflect theposition signal 66. In operation, the detectors 12A, 12B are positionedso the reflective surface extends into the writing area 38. The shape ofthe reflecting surface 138 provides the reflecting surface 138 withabout a 180 degree reception range, i.e., the reflecting surface 138will reflect positions signals 66 transmitted from a range of 180degrees. As a result, the detectors 12A, 12B can be positioned at acorner of the writing area 38 or along an edge of the writing area 38.

FIG. 7B is a side view of the detectors 12A, 12B illustrated in FIG. 7A.A position signal receiver 60 positioned at the focal point of theparabola. An example of a position signal receiver 60 that may be usedis the L-series manufactured by Polaroid. The parabolic shape causesposition signals 66 traveling at right angles to the frame 140 to bereflected into the position signal receiver 60. As a result, thereflecting surface 138 can serve to concentrate the position signals 66and increases the opportunity for a position signal 66 to be received bythe position signal receiver 60. A suitable height of the positionsignal receiver 60 above the writing surface 28 includes, but is notlimited to, approximately 1.7 inches. A suitable radius for thefootprint of the reflecting surface includes, but is not limited to,approximately 1.8 inches. A suitable equation for defining the shape ofthe parabola includes, but is not limited to, y≈1.3x².

The reflecting surface 138 can be designed to receive position signals66 from varying angles. For instance, the reflecting surface 138 canhave a parabola shaped profile which is rotated about 90 degrees aboutthe parabola's focus as illustrated in FIG. 7C. As a result, thereflecting surface has a 90 degree range of reception. The frame 140 canact as a filter by screening signals from outside the reception rangeand accordingly outside the writing area 38. A detectors 12A, 12B havinga 90 degree range of reception can be positioned at a corner of thewriting area 38.

FIG. 7D illustrates a detector assembly 72 with the hardware unit 14mounted on the coupling member 74. A cable 144 configured to be coupledwith the processing unit 20 extends from the hardware unit 14. The cable144 can be permanently coupled with the hardware unit 14 or can beremovably coupled with the hardware unit 14 via a serial port. Inoperation, the coupling member 74 is attached to the writing surface 28via the attachment mechanisms. The coupling member 74 can be attachedalong the top, bottom or side of the writing surface 28. Since thehardware unit 14 is positioned adjacent the writing surface 28, thereference signal transmitter 62 or the reference signal receiver 56 canbe included on the hardware unit 14. Although the detectors 12A, 12Billustrated in FIG. 7A are shown as the detectors of FIGS. 6A-6B, thedetectors of FIGS. 7A-7C can be substituted.

FIGS. 7E and 7F illustrate a detector assembly 72 with a coupling memberserving as the hardware unit 14 by housing the electronics performingthe functions associated with the hardware unit 14. The attachmentmechanisms 136, the first detector 12A and the second detector 12B canbe removably coupled with the coupling member 74 or can be integral withthe coupling member 74. The coupling member 74 can be constructed from afirst member 146 and a second member 148. The first member 146 can becoupled to the second member 148 by a hinge 150 extending through avertical side of the coupling member 74. As illustrated in FIG. 7G, thehinge 150 permits the coupling member 74 to adopt two or moreconfigurations. A distance between the first and second detectors canchange in at least two of the configurations. As illustrated in FIGS. 7Eand 7F, in one configuration, the detector assembly 72 adopts aconfiguration where the displacement between the detectors is known. Asillustrated in FIG. 7G, the detector assembly 72 can adopt a secondconfiguration where the first and second detector are adjacent to oneanother. The second configuration can place the detector assembly 72 ina more compact form which is suitable for transporting the detectorassembly 72.

To facilitate the formability of the detector assembly 72, theelectronics can be positioned primarily within the first or secondmember 146, 148. Flexible wiring can pass through or in proximity of thehinge 150 to permit electrical communication between the first member146 and the second member 148. For instance, the signals from the seconddetector 12B coupled with the second member 148 can be communicated withthe electronics positioned primarily in the first member via flexiblewires passing through the hinge 150 or in proximity to the hinge 150.

As illustrated in FIG. 7H, the hinge 150 can also extend through ahorizontal side of the coupling member 74. The detector assembly 72 canalso include a third member 152 and a second hinge 154 as illustrated inFIG. 7I. The first and second hinges 150, 154 permit the detectorassembly 72 to adopt a first configuration and a second configuration.

The coupling member 74 can include releasable locking mechanisms forlocking the coupling member 74 into the first or second configuration.The locking mechanism can be included in the hinge itself or on opposingportions of the first and second members 146, 148 which come intocontact when the coupling member 74 is in a desired position. The hingecan also provide enough friction that the coupling member 74 remains ina particular position once the coupling member 74 is moved into theparticular position.

As illustrated in FIG. 7J, the detector assembly 72 can be capable oftelescopic expansion where it includes a second member 148 which fitsslidably within the first member 146. The slidability of the secondmember within the first member 146 permits the detector assembly 72 toadopt a first configuration and at least one second configuration. Asillustrated in FIG. 7K, the first member 146 includes a blockingstructure 156 and a first flange 158 while the second member 148includes a second flange 160. When the second member 148 is slid intothe first member 146, the blocking structure 156 and the second flange160 come into contact to limit the inward displacement of the seconddetector 12B. The second flange 160 contacting the blocking structurecan indicate that the coupling member 74 is in a position suitable fortransportation. When the second member 148 is withdrawn from the firstdetector 12A, the second flange 160 contacts the first flange 158 toprevent the second member 148 from being pulled out of the first member146. The contact of the first flange 158 and the second flange 160 canindicate that the coupling member 74 is in a position suitable foroperation of the transcription system.

The detector assembly 72 illustrated n FIGS. 7J and 7K can include asensor system for automatically determining the displacement, L, betweenthe detectors. For instance, the first or second members 146, 148 caninclude a resistive strip (not shown). The opposite member can include acontact which touches the resistive strip at different locationsdepending on the position of the first member 146 relative to the secondmember 148. The resistive strip and the contact can be in electricalcommunication with the hardware controller. The hardware controller cancomplete a circuit through the contact and the resistive strip. Theresistance in the circuit varies depending on the position of thecontact relative to the resistive strip. Since the position of thecontact relative to the resistive strip depends on the position of thefirst member 146 relative to the second member 148, a relationshipbetween the detector displacement, L, and the resistance in the circuitcan be determined. By using this relationship, the displacement, L,between the detectors can be determined from the resistance in thecircuit. As a result, the coupling member of FIGS. 7K and 7J can have avariable L which can be automatically determined and does not need to becalculated during calibration.

The coupling member 74 illustrated in FIGS. 7J and 7K can also includeone or more releasable locking mechanisms. The one or more lockingmechanisms can be used to lock the first and second members 146, 148relative to one another once the user has moved them into a desiredposition.

As illustrated in FIGS. 7L, the detector assembly 72 can have a firstconfiguration where the first and second detectors 12A, 12B are at aknown displacement and a second configuration where the first and secondmembers 146 and 148 are detached from one another. The firstconfiguration can be formed by inserting a portion 162 of the firstmember 146 into an opening 164 in the second member 148. Conversely, thesecond configuration can be formed by withdrawing the portion 162 of thefirst member 146 from the second member 148. The detector assembly 72can include a releasable locking mechanism which serves to retain thedetector assembly 72 in the first configuration until the user choosesto detach the first member 146 from the second member 148.

Electrical communication between the first and second members 146, 148can be achieved by including electrical leads on the first and secondmembers 146, 148 which are positioned to be in contact with one anotherwhen the first and second members are attached to one another.Alternatively, a cable can be removably attached to the first and secondmembers 146, 148. When the first and second members 146, 148 aredetached, the cable can be detached from one or both of the first andsecond members 146, 148 in order to completely detach the first andsecond members 146, 148.

FIG. 7M illustrates a user actuated attachment mechanism 136 which canbe included with the coupling member 74. The attachment mechanism 136includes a suction cup 166. A center 168 of the suction cup 166 iscoupled with a member 170 extending through an opening 172 in thecoupling member 74. The member 170 is movably coupled with a cam 174included on an actuation lever 176.

In operation, the coupling member 74 is positioned so the suction cup166 is in contact with the writing surface 28. Pressure is applied tothe suction cup 166 to force air out from between the suction cup 166and the writing surface 28. Forcing the air out causes a vacuum to beformed between the suction cup 166 and the writing surface 28. Asillustrated, an end of the actuation lever 176 is then actuated so as torotate the cam 174. The rotation of the cam 174 causes the center of thesuction cup 166 to be pulled toward the coupling member 74. The couplingmember 74 can include supports 178 which keep the coupling member 74 ata constant displacement from the writing surface 28. Since the couplingmember 74 is at a constant distance from the writing surface 28, themotion of the center 168 of the suction cup 166 toward the couplingmember 74 serves to increase the amount of vacuum between the suctioncup 166 and the writing surface 28. As a result, the user actuatedsuction cups 166 can support a load exceeding the load which issupportable by normal suction cups. The increased load support abilityprovides sufficient support for a detector assembly 72 to be mounted toa vertical writing surface 28.

Although the above discussion describes the user actuated attachmentmechanism 136 as being included on the coupling member 74, theattachment mechanism 136 can be included on a first and/or seconddetector 12A, 12B which stands independently or which is included in adetector assembly 72. Further, the number of user actuated attachmentmechanisms 136 on a single detector and/or coupling member 74 can beincreased until a detector or detector assembly is held firmly in placeon a writing surface 28.

In FIG. 7D, the detectors 12A, 12B are illustrated as having a 180degree angular range of reception. However, is noted that the detectors12A, 12B preferably have ranges of reception selected from the group ofabout 70 to 110 degrees, about 80 to 100 degrees, about 90 degrees,about 160 to 200, about 170 to 190 degrees, and about 180 degrees.

As illustrated in FIGS. 7A and 7C, the angular range of reception can beat least partially defined by a shielding element 140. The shieldingelement 140 is oriented relative to the position signal receiver 60 toshield the position signal receiver 60 from position signals transmittedby the stylus 10 when the stylus 10 is positioned outside apredetermined region 180. FIGS. 7N and 7O illustrate portions of apredetermined region 180 for detectors 12A, 12B with a range ofreception of about 90 degrees and about 180 degrees respectively. InFIG. 7N, the predetermined region 180 has an angular range of about 90degrees extending outward from the detector parallel to the writingsurface 28. In FIG. 7O, the predetermined region 180 has an angularrange of about 180 degrees extending outward from the detectors 12A, 12Bparallel to the writing surface 28. The predetermined region preferablyhas an angular range selected from the group including about 70 to 110degrees, about 80 to 100 degrees, about 90 degrees, about 160 to 200,about 170 to 190 degrees, and about 180 degrees.

The detector assembly may include a plurality of control switches 182and an indicator 184, as illustrated in FIGS. 7D, 7F and 7G. The usercan activate each control switch 182 to control various functions whichare performed by the processing unit 20 or the hardware unit 14. Forexample, activating a control switch can cause the current monitor image34 to be saved; cause the current monitor image 34 to be saved and movedto the background while a new monitor image area 36 is brought to theforeground for the creation of a new monitor image 34; cause the currentmonitor image 34 to be moved to the background while a new monitor imagearea 36 is brought to the foreground for the creation of a new monitorimage 34; cause a copy of the current monitor image to be saved in thebackground while the current monitor image remains in the foreground forany additional adjustments; cause the entire monitor image 34 to beerased while retaining the current monitor image area 36 in theforeground; bring a new monitor image area 36 into the foreground;maximize the current monitor image area 36 to fill the available spaceon the monitor; bring the last monitor image area 36 to the foregroundwhen another program was last used in the foreground; notify theprocessing unit 20 that an overlay has been positioned on the writingsurface; notify the processing unit 20 that an overlay has been removedform the writing surface; enable or disable selected functions; changeor select the color of particular strokes on the monitor image 34;change the particular color correlated with a particular stylus 10; faxthe monitor image 34; E-mail the monitor image 34; and/or print themonitor image 34. As discussed, certain embodiments of the transcriptionsystem require calibration, and activating a particular control switchcan initiate calibration or recalibration. As discussed, thetranscription system can be used simultaneously with other programs.Activating the control switches can serve to control the variousfunctions of these other programs. For instance, actuating a particularcontrol switch can cause POWER POINT to move to the next slide ordisplay. Similarly, activating a different control switch 182 can causePOWER POINT to move to the previous slide or display. A wide variety ofadditional system functions can be envisioned and are intended to fallwithin the scope of the present invention.

The indicators 184 can be used to indicate to the user a condition ofthe system. For instance, an indicator 184 can be an LED which flasheswhen a power source within the stylus 10 is running low in power, toacknowledge that a control switch 182 has been activated and/or toacknowledge that an error condition has occurred.

As illustrated in FIGS. 6A, 7B and 7C, the first and/or the seconddetector 12A, 12B can include a contact switch 186 coupled with thedetector electronics 130. The contact switch is closed when thedetectors 12A, 12B is positioned adjacent the writing surface 28 and isopened when the detectors 12A, 12B are removed from the writing surface28. The detector electronics can include logic for identifying when thecontact switch has gone from closed to open. In response, the detectorelectronics 130 can provide a re-calibrate signal which is received bythe hardware unit 14. The hardware unit 14 includes logic foridentifying the re-calibrate unit.

Electronics

FIG. 8A illustrates a block diagram for controlling the transmission andemission of the various reference signals 64 and position signals 66 andfor determining the time for the first and second detectors 12A, 12B toreceive a position signal 66. Various portions of block diagram arepositioned in the first detector 12A, the second detector 12B, thehardware unit 14, the processing unit 20 and/or an implement 210 whichcan be either a stylus 10 or an eraser 16. For instance, the implement210 includes a reference signal receiver 56 coupled with a triggercircuit 188 which is coupled with a position signal transmitter 58. Thetrigger circuit 188 triggers the transmission of a position signal 66 inresponse to receiving a reference signal 64. The first detector 12Aincludes a position signal receiver 60 coupled with a first detectorcircuit 190. The second detector 12B includes a reference signaltransmitter 62 and a position signal receiver 60 coupled with a seconddetector circuit 192. The detector circuits provide a signal when theposition signal receiver 60 has received a position signal 66.

The output from the first detector circuit stops a first timer 194 andasserts a first toggle within a toggle block 196. The output from thesecond detector circuit 192 stops a second timer 198 and asserts asecond toggle within the toggle block 196. The first timer 194, thesecond timer 198 and the toggle block 196 can be located within thehardware unit 14 and/or the processing unit 20.

The hardware unit 14 and/or the processing unit 20 includes a hardwarecontroller 200. Examples of hardware controllers that can be usedinclude, but are not limited to microsequencer, microcontroller ormicroprocessor. The hardware controller 200 periodically provides aDRV₋₋ XMIT signal on a DRV₋₋ XMIT line. The DRV₋₋ XMIT signal isreceived by the first timer 194, the second timer 198, the toggle block196 and the reference signal transmitter 62 in the second detector 12B.The DRV₋₋ XMIT signal is also received by a timeout counter 202.

In operation, the hardware controller 200 provides a DRV₋₋ XMIT signalwhich causes the reference signal transmitter 62 to transmit a referencesignal 64, resets the first and second timers 194, 198 and clears anytoggles within the toggle block 196 which were previously asserted. Thereference signal receiver 56 receives the reference signal 64. Thetrigger circuit 188 triggers the position signal transmitter 58 totransmit a position signal 66. The position signal receiver 60 withinthe first detector 12A receives the position signal 66 and the firstdetector circuit provides a signal indicating that a position signal 66has been received. The signal from the first detector circuit stops thefirst timer 194 and asserts the first toggle in the toggle block 196.The position signal receiver 60 in the second detector 12B receives theposition signal 66 and the second detector circuit 192 provides a signalindicating that a position signal 66 has been received. The signal fromthe second detector circuit 192 stops the second timer 198 and assertsthe second toggle in the toggle block 196.

When the first and second toggles are asserted, an RCV₋₋ DONE? signal isreceived by the hardware controller 200. The hardware controller 200sequentially activates the tri-state buffers 204. The data from thefirst timer 194 is received on a bus 206 via the tri-state buffers 204.The data from the second timer 198 is received on the bus 206 via thetri-state buffers 204. The processing unit 20 can receive informationfrom the bus 206 via a UART 208. After the data from the first timer 194and the second timer 198 is received on the bus 206, the DRV₋₋ XMITsignal is provided again.

When the time out counter reaches some pre-determined limit, called thetimeout limit, before both toggles in the toggle block 196 are asserted,the DRV₋₋ XMIT signal is provided without the data on the first andsecond timers being received by the bus 206. As a result, if one of thedetectors 12A, 12B misses a position signal 66, the next cycle ofposition detection is performed. The timeout limit can beadministratively set to some value which is appropriate for most writingsurfaces 28. The timeout limit can also be calculated by the processingunit 20 or the hardware controller 200. When the timeout limit iscalculated, the timeout limit can be determined by dividing the writingarea diagonal, D, by the speed of sound. The calculated timeout can beincreased by some administratively determined factor. Whether thetimeout limit is an administratively set value or a calculated value, itis conceivable that the transcription system can record the position ofthe implement when the implement is positioned outside the writing area38 or off the writing surface 28.

FIG. 8B illustrates another embodiment of a block diagram forcontrolling the transmission and emission of the various referencesignals 64 and position signals 66. The block diagram is suitable foruse with the system illustrated in FIG. 2C. The implement 210 includes areference signal transmitter 62 and the hardware unit 14 includes areference signal receiver 56. The trigger circuit 188 in the implement210 is designed so a reference signal 64 and a position signal 66 areregularly transmitted from the implement 210 with a period on the orderof a typical administratively set timeout limit.

In operation, the reference signal 64 is received by the referencesignal receiver 56. Receipt of the reference signal 64 causes the firsttimer 194 and the second timer 198 to be cleared. The position signal 66is received by the first and second detectors 12A, 12B, stopping thefirst and second timers 194, 198 and asserting the first and secondtoggles within the toggle block 196. When the first and second togglesare asserted, an RCV₋₋ DONE? signal is received by the hardwarecontroller 200. The hardware controller 200 sequentially activates thetri-state buffers 204 to deliver the data from the first and secondtimers 194, 198 to the bus 206. Since the reference signal 64 and theposition signal 66 are periodically transmitted, the above sequence isrepeated when the hardware unit 14 receives another reference signal 64from the implement 210.

FIG. 8C illustrates another embodiment of a block diagram which can beused with the system illustrated in FIG. 2C. The implement 210 includesa reference signal transmitter 62 and the hardware unit 14 includes areference signal receiver 56. The trigger circuit 188 in the implement210 is designed so for each reference signal 64 transmitted from theimplement 210, a plurality of position signals 66 are regularlytransmitted from the implement 210 with a period on the order of thetimeout limit.

In operation, upon activation of the implement electronics by placingthe implement 210 in contact with the writing area 38, a referencesignal 64 is transmitted from the implement 210 along with a positionsignal 66. The reference signal 64 is received by the reference signalreceiver 56. In response to receiving the reference signal 64, thehardware controller 200 provides an DRV₋₋ XMIT signal which clears thefirst timer 194, the second timer 198 and the timeout counter 202. Theposition signal 66 is received by the position signal receivers 60,stopping the first and second timers 194, 198 and asserting the firstand second toggles within the toggle block 196. When the first andsecond toggles are asserted, an RCV₋₋ DONE? signal is received by thehardware controller 200. The hardware controller 200 sequentiallyactivates the tri-state buffers 204 to deliver the data from the firstand second timers 194, 198 to the bus 206 and over a serialcommunication line via the UART 208 to the processing unit 20.

After the timeout counter reaches a defined time interval, the hardwarecontroller 200 provides another DRV-XMIT signal. The defined timeinterval is equal to the period which the position signals 66 aretransmitted from the implement 210. This time interval allows thehardware controller 200 to provide DRV-XMIT signals with the samefrequency that the position signals 66 are transmitted. Further, theDRV-XMIT signals are provided at approximately the same time theposition signals 66 are transmitted. As a result, the reference signal64 serves to synchronize the DRV-XMIT signals with the transmission ofposition signals 66. The reference signal 64 can be transmitted with afrequency which is sufficient to prevent drift in the synchronizationbetween the transmission of the position signals and the DRV-XMITsignals.

In each of FIGS. 8A-8C, the hardware unit 14 includes control switches182. Signals from the control switches 182 and the position signalreceiver 60 are received by the hardware controller 200. Suitablecontrol switches 182 include, but are not limited to toggle switches andcontact switches. Each hardware unit 14 also includes indicators 184which can be activated by the hardware controller 200 or the processingunit. The indicators can be used to indicate to the user variousconditions of the system. Suitable indicators include, but are notlimited to, an LED, an LCD display, an LED display, a speaker forproviding audible messages, a beeper and a buzzer.

In operation, the control switches 182 can be activated by the user.Based on the particular control switch 182 which is activated, thehardware controller 200 can perform a particular function itself or canload a second control signal onto the bus 206. The processing unit 20can include logic for identifying the second control signal and carryingout a function in response to the particular control signal. Examples offunctions which can be carried out by the hardware unit 14 or theprocessing unit are described above.

The hardware controller 200 can include logic for identifying varioussignals encoded into the position signals or encoded into the referencesignals. For instance, the hardware controller 200 can include logicwhich identifies a power signal, an identity signal and/or a pressuresignal encoded into position signals 66 or reference signals. Inresponse to identifying at least one of these signals, the hardwarecontroller 200 can load a second power, identity and/or pressure signalonto the bus 206. The second power, identity and pressure signals can bethe same or different than the power, identity and pressure signalswhich were originally received. The hardware controller 200 can alsoactivate an indicator 184 in response to identifying one of thesesignals. For instance, the indicator can be an LED and the hardwarecontroller 200 can light the LED in response to identifying a powersignal. As discussed above, the hardware controller 200 can includelogic for identifying the implement 210 based on the response of theimplement 210 to an inquiry signal. When the implement 210 has beenidentified, an identity signal can be loaded onto the bus 206. Theprocessing unit 20 is in communication with the bus 206 and can includelogic for identifying and responding to at least one of the signalswhich have been loaded onto the bus 206. The response of the processingunit 20 to identifying these signals will be discussed in more detailbelow.

The hardware controller 200 can also include logic for identifying errorconditions. Example error conditions include, but are not limited to, auser's hand blocking a portion of the position signal transmitter and adetector 12A, 12B being moved after the system was calibrated. Theseerror conditions can be identified when one of the detectors 12A, 12Breceives a position signal while the other detector does not. The errorcondition can be identified when an RCV₋₋ DONE? signal is not receivedbefore the next cycle is begun as indicated by transmission of aposition signal. The lack of the RCV₋₋ DONE? signal indicates that onlyone or none of the toggles were asserted before a new cycle wasinitiated as indicated by transmission of a position signal. When thiscondition is met for some pre-determined number of cycles, an errorcondition has occurred. The user can be notified of this indication viaan indicator 184. For instance, the indicator can be an LED whichflashes when the error condition is identified or a speaker whichproduces an audible message or an audible beep. Further, the hardwareunit 14 can load an error signal onto the bus so it can be received bythe processing unit. The processing unit can include logic foridentifying the error signal and responding to it. For instance, uponidentifying the error signal, the processing unit can cause an errormessage to appear on the monitor.

The hardware controller 200 illustrated in FIGS. 8A-8C can include logicfor identifying when the implement 210 has been removed from the writingarea 38. For instance, when position signals are not received for somepre-determined period of time, the implement can be characterized asbeing removed. One method for determining that the pre-determined periodof time is elapsed is to monitor the number of times that the timeoutcounter 202 consecutively reaches the timeout limit. When apre-determined number of timeouts has been achieved, the implement 210is characterized as being removed from the writing area 38. The numberof timeouts that should occur before the implement 210 is characterizedas removed from the writing area 38 is preferably 1-20, more preferably2-10 and most preferably 2-3.

The hardware controller 200 can also include logic for communicating tothe processing unit 20 that the implement 210 has been removed from thewriting area 38. As illustrated in FIGS. 8A-8C, signals from thehardware controller 200 can be received by the bus 206. When thehardware controller 200 identifies that the implement 210 has beenremoved from the writing area 38, the hardware controller 200 can load astylus removed signal onto the bus 206. The processing unit 20 includeslogic for identifying the stylus removed signal and adjusting themonitor image 34 accordingly.

The hardware controller 200 can also be coupled with detector circuits190, 192 within the first or second detector 12A, 12B. The hardwarecontroller 200 can include logic for identifying a re-calibrate signalprovided by the detector electronics. As described above, there-calibrate signal occurs when the first or second detector 12A, 12Bhas been removed from the writing surface 28. In response to identifyingthe re-calibrate signal, the hardware controller 200 can load a secondre-calibrate signal onto the bus where it can be accessed by theprocessing unit. In response, the processing unit can initiate are-calibration of the system.

The hardware controller 200 can also include logic for encoding inquirysignals into the reference signals 64 transmitted from the referencesignal transmitter 62. As described in more detail below, these inquirysignals are identified by the implement 210 which can respond to theinquiry signal. The sequence of inquiry signals and responses can beused to identify the implement 210.

In each of FIGS. 8A-8C, the hardware controller 200 is coupled with atemperature sensor 212 so as to receive a temperature signal from thetemperature sensor 212. There is a known relationship between the speedof sound and temperature. As will be described in detail below, thespeed of sound can play a role in calibration of the transcriptionsystem and determining the position of the stylus 10. As a result, thehardware controller 200 can produce a second temperature signal which isreceived by the processing unit 20. The processing unit 20 can processthe second temperature signal to determine the speed of sound which canthen used in calibration and position calculations. The processing unit20 can also include logic for monitoring the second temperature signaland periodically recalculating the speed of sound. Alternatively, thehardware controller 200 can include logic for processing the temperaturesignal to determine the speed of sound. The hardware controller 200 canthen produce a speed of sound signal which is received by the processingunit 20. The processing unit 20 can then process the speed of soundsignal to determine the speed of sound for use in calculations. Thehardware controller can also include logic for periodically monitoringthe temperature sensor 212 and updating the speed of sound signal.

Although the temperature sensor 212 is illustrated as being locatedwithin the hardware unit 14, the temperature sensor is preferablylocated where it can be positioned close to the writing surface 28during operation of the transcription system. Proximity to the writingsurface 28 provides information regarding the temperature at the writingsurface 28 where changes in the temperature are most likely to influencethe transcription system. Suitable locations for the temperature sensor212 include, but are not limited to, a first detector 12A, seconddetector 12B, or coupling member 74. The temperature sensor 212 can alsobe included in an independent module which can be coupled to the writingsurface 28. Further, the temperature sensor 212 can be coupled directlyto the processing unit 20. As a result, the processing unit 20 canreceive and process the temperature signal directly. Additionally, thetranscription system can include a plurality of temperature sensors 212in different locations to maximize the accuracy of temperaturedeterminations or to identify the existence of temperature gradients.Suitable temperature sensors 212 include, but are not limited to,thermocouples and thermistors.

The hardware units 14 illustrated in FIGS. 8A-8C can include an internalpower source such as a battery or can include a cable to an externalpower source such as a wall socket or the processing unit 20. Thehardware units 14 can also include a power switch, such as a toggleswitch, for turning the hardware unit 14 on and/or off. One of theindicators 184 can indicate whether the hardware unit 14 is on or off.For instance, the indicator 184 can be an LED which is lit when thehardware unit 14 is switched in. Further, the hardware unit 14 caninclude a power level sensor for detecting a level of power available tothe hardware unit 14. When the available power level falls below aparticular threshold level, this can be indicated to the user by anindicator 184. For instance, the indicator 184 can be an LED which islit when the power level falls below the threshold or an LED used toindicate whether the hardware unit 14 is on or off can flash when thepower level falls below a particular threshold.

The block diagrams illustrated in FIGS. 8A-8C can be readily adapted foruse with other transcription system embodiments, such as thetranscription system embodiments illustrated in FIGS. 2B-2D. Forexample, in order to adapt the block diagrams for use with thetranscription system illustrated in FIG. 2B, the reference signaltransmitter 62 and the reference signal receiver 56 can be replaced witha wire for carrying the reference signal 64.

In FIGS. 8A-8C, the first and second detector circuits 190, 192 areillustrated as being positioned in the first and second detectors 12A,12B. It is noted, however, that the first and second detector circuits190, 192 may also be included in the hardware unit 14. Further, thereference signal transmitter 62 is illustrated as being positioned inthe second detector 12B in FIGS. 8A and 6B. However, the referencesignal transmitter 62 can also be positioned in other locations withinthe system including the hardware unit 14. Further, although thehardware unit is illustrated as a housing containing electronics, thehardware unit can refer to a collection of electronics which perform thefunctions discussed as being performed within the hardware unit. As aresult, the hardware unit is conceivably distributed among severallocations.

The block diagrams illustrated in FIGS. 8A-8C can be adapted for usewith other systems. For instance, the block diagram illustrated in FIG.8A can be adapted for use with the system illustrated in FIG. 3B byincluding a reference signal receiver 56 within the first detector 12Aand replacing the position signal receiver 60 in the first detector 12Awith a position signals transceiver 70. The first detector 12A can thenbe designed so the position signal transceiver 70 responds to receivinga reference signal 64 during calibration of the system by transmitting aposition signal 66.

An example of a trigger circuit 188 that may be included in theimplement electronics 104 is illustrated in FIG. 9. The trigger circuit188 triggers the position signal transmitter 58 to transmit a positionsignal 66 in response to a reference signal receiver 56 receiving areference signal 64. The circuit can be included in the stylus 10 or inthe eraser 16. The trigger circuit 188 includes a transistor 214, afirst node 220, a second node 222 and a transformer 224. An n-channelMOSFET transistor is shown with a self-contained zener diode, but othersuitable devices might also be used. A power source 226 is coupled withthe first node 220. Suitable power sources 226 include, but are notlimited to, a battery such as a 5 V battery. Suitable position signaltransmitters include, but are not limited to, an ultrasound transducer.

The first node 220 is also coupled with the transformer. A suitabletransformer transforms the 5 V signal to a 570 V peak-to-peak signal.The transformer 224 is coupled with the source of the transistor 214.The drain of the transistor is coupled with the ground. The transformer224 is coupled with the ultrasound transducer 58. A resistor 216 iscoupled in parallel between the transformer to assist in dampingelectrical ringing. When the potential at the second node 222 exceeds athreshold potential, current flows from the power source 226, throughthe transformer 224 and the transistor 214, to the ground. The voltageoutput from the transformer 224 drives the ultrasound transducer 58. Asa result of this configuration, the ultrasound position signal 66 istriggered by the IR reference signal 64.

As shown above, the second node 222 is coupled with the base of thetransistor 214. The second node 222 can also be coupled with additionalelectronics within the implement electronics 104 and/or a referencesignal detector via an amplifier (not shown). The second node 222 canalso be coupled with the hardware unit 14 via an electrical wire 68 asillustrated in FIG. 2B. When the second node 222 is coupled with thehardware unit 14, the ultrasound position signal 66 is triggered by areference signal 64 received via the electrical wire 68. Similarly, whenthe second node 222 is coupled with a reference signal receiver, theultrasound position signal 66 is triggered by a reference signal 64received at the reference signal receiver.

FIG. 10 illustrates a detector circuit which may be used as the firstand/or second detector circuit illustrated in FIGS. 8A-8C. The detectorcircuit is typically included in the detector electronics 130 but may bepositioned in another location within the system. The detector circuitincludes an amplifier 230, a low pass filter 232, rectifier 234 and acomparator 236. In operation, the signal received at the position signalreceiver 60 is amplified and then filtered. The filtered signal is thenrectified. The rectified signal is provided to the comparator whichprovides a signal when the signal from the rectifier rises above somethreshold value. The signal from the comparator indicates that aposition signal 66 has been received at the position signal receiver 60.

In the circuit illustrated in FIG. 10, the presence of the rectifier 234improves the quality of the monitor image 34. One source of error increation of the monitor image 34 results when the leading edge of theposition signal 66 does not exceed the comparator's 236 threshold valuebut a subsequent part of the same signal does exceed the thresholdvalue. This error results in the stylus 10 appearing further from firstand second detectors 12A, 12B than the true location of the stylus 10.Rectifying the signal increases the opportunity for the comparator'sthreshold value to be exceeded and the position signal 66 detected. Theearlier a position signal 66 is detected, the less severe the errordescribed above. As a result, the rectifier 234 serves to reduce theerror resulting from missed position signals 66.

Converting Time of Flight Signals to a Recorded Image

FIGS. 11A-11B illustrate how the time of flight measurements may betranslated into an image on a monitor image area 36. The first andsecond detectors 12A, 12B are displaced by a distance, L. The writingarea 38 has a width dimension, W, a height dimension, H and a diagonaldirection, D. Similarly, the monitor image area 36, has a widthdimension, w and a height dimension h. Each of these dimensions areillustrated in FIG. 11A. The L, H and W dimensions can be known valuesor can be determined during calibration of the system. Once, the H and Wdimensions are determined, the monitor image area 36 is created on themonitor 22. The monitor image area 36 is created with a h:w ratio whichmatches the ratio of H:W. As a result, the actual h and w values canvary. After the monitor image area 36 is created, the size anddimensions of the monitor image area 36 can be adjusted by the userusing traditional techniques for manipulating windows. For instance, amouse can be used to click and drag an edge or corner of the monitorimage area 36. Further, the size of the monitor image 34 relative to themonitor image area 36 can be magnified and reduced by the user withtraditional techniques for magnifying and reducing images on a monitor.An example of a typical techniques for user magnification and reductionof images and image areas is used in drawing programs such as VISIO,etc. Scroll bars can be included on the monitor image area 36 to scrollto portions of the monitor image 34 which are not currently displayed onthe monitor. It is conceivable that the user may write outside thewriting area 38. When a user writes outside the writing area, theprocessing unit can include logic for expanding the size of the monitorimage area 36 to accommodate positions outside the writing area 38.

As illustrated in FIG. 11B, a Cartesian coordinate system can betransposed on the writing area 38. The coordinate system is transposedon the writing area 38 so the corners of the writing area 38 ispositioned at (0, 0), (0, H), (W, 0) and (W, H). The position of thestylus 10 relative to the corners of the writing area 38, (x, y), can bedetermined using Equation 1 and Equation 2. ##EQU1##

    y=(l.sup.2 -x.sup.2).sup.1/2                               Equation 2

As illustrated in FIG. 11B, the variable l represents the distancebetween the stylus 10 and the first detector 12A. The variable rrepresents the distance between the stylus 10 and the second detector12B. The variables r and l can be calculated from Equation 3 andEquation 4.

    l=Ct.sub.1                                                 Equation 3

    r=Ct.sub.2                                                 Equation 4

The variable t₁ is the time of flight of the position signal 66 betweenthe stylus 10 and the first detector 12A and t₂ is the time of flight ofthe position signal 66 between the stylus 10 and the second detector12B. C is the speed of sound. As described above, C can be a function oftemperature. As described above, the transcription system can include atemperature sensor 212 and logic for determining the speed of sound fromtemperature measurements. As a result, when the transcription systemincludes a temperature sensor 212, the determined speed of sound is usedin these calculations. When the transcription system does not include atemperature sensor 212, the speed of sound at standard conditions can beused. ##EQU2##

    x=(r.sup.2 -y.sup.2).sup.1/2                               Equation 6

FIG. 11C illustrates the first and second detectors 12A, 12B positionedalong a side of the writing area 38. The Cartesian coordinate systemtransposed on the writing area 38 illustrated in FIG. 11B is transposedon the writing area 38 illustrated in FIG. 11C. Although the coordinatesystem is the same, the changed position of the first and seconddetectors 12A, 12B relative to writing area 38 requires a different setof equations to determine the stylus position, (x, y). The stylusposition, (x, y), can be determined using Equation 5 and Equation 6.

As illustrated in FIGS. 11B and 11C, a Cartesian coordinate system isalso transposed on the monitor image area 36. The corners of the monitorimage area 36 are defined as (0, 0), (0, H), (W, 0) and (W, H) so theyare correlated to the position of the writing area corners 38. As aresult, the stylus position, (x, y), on the writing area 38 translatesto a position on the monitor image area 36.

Creation of the monitor image 34 is illustrated in FIG. 11D. The stylusposition, (x, y) is periodically sampled as the stylus is moved alongthe writing area 38. For instance, during the stroke illustrated in FIG.11C, the stylus position during each sample is expressed as a set ofCartesian coordinates, (x_(n), y_(n)). The sampled positions are thentranslated to positions on the monitor image area 36. The image formswhen line segments are drawn between consecutively sampled positionswhich have been translated to the monitor. The resolution of the monitorimage 34 can be increased by increasing the frequency that the stylusposition, (x, y), is sampled. Further, the resolution of the monitorimage 34 can also be smoothed with position filtering logic as will bediscussed below.

Data Structures

FIG. 12 provides a block diagram of an embodiment of the system. Theprocessing unit 20 illustrated includes a processor 238 in communicationwith a memory 240 including a volatile memory 242 and a storage unit244. Suitable processing units 20 include, but are not limited to, IBMand Macintosh personal computers and central servers. The processor 238is also in communication with the hardware unit 14 via an input/outputunit 246 and a serial channel 248. Suitable processors 238 include, butare not limited to, microprocessors and CPUs. The storage unit caninclude logic and various data structures. The volatile memory 242 isutilized during execution of the logic included in the storage unit 244.

FIG. 13 illustrates a data structure for an image data structure whichcan be stored in the memory 240. The image data structure includes acolumn of x fields 250 correlated with y fields 252. As described above,the position of the stylus 10 relative to the detectors is periodicallysampled as the stylus 10 is moved along the writing area 38. TheCartesian coordinates for the sampled positions are stored in the imagedata structure. The x coordinate for each sampled position is stored inan x field and the y coordinate for the position is stored in thecorresponding y field.

The monitor image 34 is created by forming lines between sequentialpositions in the image data structure to form a stroke. Certain rows caninclude break entries which indicate that the stylus 10 was removed fromthe writing surface 28. These entries are created when an activation ordeactivation signal 66 has been received as discussed above. When suchan entry exists, lines, splines and the like may be drawn between theseries of positions following the entry but not between positions onopposite sides of the entries. As a result, a second stroke is createdwhich is independent of the first stroke.

FIG. 14 illustrates an implement characteristic data structure 254 whichcan be stored in the memory 240. The implement characteristic datastructure 254 includes a column of implement identifier fields 256correlated with implement fields 258, first implement characteristicfields 260 and second implement characteristic fields 262. The implementidentifier field 256 lists an identifier which can be unique to eachtype of implement which can be used on the writing area 38. Forinstance, each type of stylus 10 and each type of eraser 16 can beidentified by a unique number. Each implement field 258 lists whetherthe implement is an eraser 16, a stylus 10 or other implement which canbe used on the writing area 38. The first implement characteristic field260 and the second implement characteristic field 262 listcharacteristics of the implement identified in the correspondingimplement field 258. For instance, when the identified implement is astylus 10, the first implement characteristic field 260 can listinformation indicating the color or thickness of the stroke left by thestylus 10. The implement characteristic data structure 254 canoptionally include additional implement characteristic fields which canlist additional implement characteristics.

The implement characteristic data structure 254 is used to identify theimplement being used on the writing area 38. As a result, when theeraser 16 is being used on the writing area 38, the monitor image 34 iserased. Further when the stylus 10 is being used on the writing area 38,the characteristics correlated with the identified stylus 10 can be usedto create each stroke on the monitor image 34. For instance, when a bluestylus 10 is used to write on the writing area 38, the strokes whichappears on the monitor image 34 can be created with a blue color. As aresult, the characteristics of the monitor image 34 can be reflected inthe written image 44.

It is noted that the system can be adjusted such that when strokes ofdifferent colors cross over each other, the system may either displayone stroke on top of the other stroke, or illustrate the overlappingportion of the strokes as a mixture of the different colors. Forexample, when a blue stroke is written over a yellow stroke, the systemmay either record the overlapping portion as being the first stroke(yellow), the last stroke (blue), or a combination of the two strokes(green). By providing a mixture of the different colored strokes, theactual appearance of the image formed by the different strokes can bebetter simulated.

FIG. 15A illustrates an control section relative to template datastructure which can be stored in the memory 240. The control sectionrelative to template data structure includes a function field 264 and aplurality of coordinate fields 266-280. The plurality of coordinatefields include an x' upper left corner field 266, a y' upper left cornerfield 268, an x' upper right corner field 270, a y' upper right cornerfield 272, an x' lower left corner field 274, a y' lower left cornerfield 276, an x' lower right corner field 278 and a y' lower rightcorner field 280. The x' upper left corner field 266 and the y' upperleft corner field 268 lists the coordinates of the upper left corner ofa particular control section 32 on the template 18. Similarly, theremaining coordinate fields 270-280 list the coordinates for othercorner of the particular control section 32. The coordinates are listedrelative to the template 18. For instance, an imaginary or realcoordinate system can be transposed on the template 18 with the originof the coordinate system located at one calibration mark 40 and an axisof the coordinate system extending through another calibration mark 40.The coordinates listed in fields 266-280 are measured on the transposedcoordinate system. As a result, the listed coordinates indicate thespatial relationship of each control section 32 relative to thecalibration marks 40.

Each set of coordinate fields 266-280 is correlated with a functionfield 264 which lists a function performed by the hardware unit 14 orthe processing unit 20 when the stylus 10 is positioned within thecontrol section 32 defined by the coordinate fields 266-280. Forinstance, when the stylus is positioned within an control section 32with coordinates corresponding to the function field 264 labeled"print", the hardware unit 14 or the processing unit 20 will cause themonitor image 34 to be printed. Similarly, when the stylus is positionedwithin an control section 32 with coordinates corresponding to thefunction field 264 labeled "2", the hardware unit 14 or the processingunit 20 will cause the number 2 to be displayed in the display 48 of thecalculator image 46.

FIG. 15B illustrates an control section relative to detectors datastructure which can be stored in the memory 240. The control sectionrelative to detectors data structure includes function fields 264similar to the function fields listed in the control section relative totemplate data structure. The control section relative to detectors datastructure also includes a plurality of coordinate fields 282-296. Theplurality of coordinate fields 282-296 include an x upper left cornerfield 282, a y upper left corner field 284, an x upper right cornerfield 286, a y upper right corner field 288, an x lower left cornerfield 290, a y lower left corner field 292, an x lower right cornerfield 294 and a y lower right corner field 296. The x upper left cornerfield 282 and the y upper left corner field 284 respectively list the xand y coordinates of the upper left corner of a particular controlsection 32 on the template 18. Similarly, the remaining fields 286-296list the coordinates for other corners of the control section 32. Thecoordinates are listed relative to the detectors 12A, 12B. Specifically,the coordinates listed in fields 282-296 are measured on a coordinatesystem such as the coordinate systems illustrated in FIG. 11B and/orFIG. 11C. As a result, the listed coordinates indicate the spatialrelationship of each control section 32 relative to the detectors 12A,12B.

The data structures illustrated in FIGS. 15A and 15B presume controlsections 32 which are rectangular in shape, however, it is contemplatedthat control sections 32 with alternative shapes are also suitable foruse with the template 18. For instance, the control sections 32 can becircular, triangular, elliptical, etc. A single template 18 can includecontrol sections 32 with a single control section 32 geometries or withdifferent geometries. When the template 18 includes circular controlsections 32, the data structures illustrated in FIG. 15A and 15B caninclude fields which contain information defining the position of thecenter of the circles and fields which contain information defining thediameter of the circles. Similarly, when the template 18 includestriangular control sections 32, the data structures illustrated in FIG.15A and 15B can include fields which contain information defining thepositions of each of the three corners of the triangles.

Process Flows

The transcription system can optionally include calibration logic,stylus identification logic, image creation logic and overlaycalibration logic. The transcription system can also optionally includehandwriting recognition logic for converting the monitor image 34directly into ASCII text or converted directly into presentationsoftware such as Microsoft Power Point. Any of the logic discussed aboveor below can be included on a computer readable medium which can beloaded onto the processing unit 20 or the hardware controller 200 Thelogic may also be stored remotely and loaded onto a local processor unitor the hard ware unit by electronic transmission over a public network,such as the INTERNET. Suitable computer readable media include, but arenot limited to, computer disks, floppy disks, compact disks, tapes suchas magnetic tapes, personal digital assistants, hand held computers.Similarly, the logic can be remotely stored and accessed via a networkor modem.

The calibration logic guides the user in calibrating the system and candetermine variables required for operation of a particular embodiment ofthe transcription system. For instance, the calibration logic caninclude logic for determining a displacement between detectors, adisplacement between calibration marks and the detectors, a displacementbetween a template and the detectors, and a displacement between acontrol section and the detectors, and the writing area dimensions. Aswill be described in more detail below, the logic required can varybetween different embodiments of the transcription system.

The calibration logic may be accessed when the user installs thetranscription system on a new writing surface. The calibration logic canalso be accessed at the command of the user when the user feels thesystem may have become uncalibrated. The re-calibrate command can begiven by activating a particular control switch 182, by positioning thestylus within the perimeter of a particular control on the template,section or by using a user interface to provide particular input to theprocessing unit or hardware unit. Further, the calibration logic can bebroken up into smaller bits of logic which can be accessed independentlyas will be described below.

An example of calibration logic process flow is illustrated in FIG. 16A.Portions of the calibration logic which pertain to logic for determiningthe detector displacement, the control section positions and the writingarea dimensions are labeled as such in the brackets along the left edgeof FIG. 16A. The process flow of FIG. 16A is suitable for use with thesystems illustrated in FIGS. 2A-2D which can require use of the template18 during the determination of the displacement between the detectors.Because the template is used during the determination of thedisplacement between the detectors 12A, 12B and during determination ofthe control section positions, there can be some overlap in the logicused to determine the control section positions and in the logic used todetermine the detector displacement. This overlap is illustrated bylabeled brackets which vertically overlap in FIG. 16A.

The logic for determining the writing area dimensions can be independentfrom the logic for determining detector displacement and control sectionposition as illustrated by the brackets in FIG. 16A. As a result, it isconceivable that different portions of the calibration logic can beaccessed independently, i.e. at different times during operation of thetranscription system. For instance, the user can determine controlsection positions several times but determine the writing areadimensions once but As a result, the user can move the template 18 to anew position on a writing surface and then determine the new controlsection positions without having to re-determine the dimensions of thewriting area.

In FIG. 16A, control is passed from the start block 298 to process block300. At process block 300 the user is directed to touch the stylus 10 tothe calibration mark 40 in the upper left corner of the template 18. Thedirection takes the form of creating a template image 42 on the monitor22 and showing a stylus 10 contacting the upper left corner of thetemplate 18 as discussed with respect to FIG. 1C. Control is then passedto process block 302 where the time for the position signal 66 to passfrom the stylus 10 to the first detector 12A and the second detector12B, t₁ and t₂, is accessed from the bus 206. Control is then passed toprocess block 304 where r and l are calculated via Equation 3 andEquation 4. The calculated r and l are stored as r₁ and l₁. Control isthen passed to process block 306 where the user is directed to touch thestylus 10 to the calibration mark 40 in the upper right corner of thetemplate 18. Control is then passed to process block 308 where the timefor the position signal 66 to pass from the stylus 10 to the firstdetector 12A and the second detector 12B, t₁ and t₂, is accessed fromthe bus 206. Control is then passed to process block 310 where r and lare calculated via Equation 3 and Equation 4. The calculated r and l arethen stored as r₂ and l₂. ##EQU3##

    H=y.sub.1 +C                                               Equation 8

Control is passed from process block 310 to process block 312 where thedisplacement between the detectors, L, is determined by using the storedr₁, l₁, r₂, and l₂ in Equation 7, where w_(T) is a known constant equalto the width between the calibration marks 40 on the template 18. Thecalculated L is then stored.

Control is passed from process block 312 to process block 314 where thecoordinates of the control sections 32 on the template 18 is determinedrelative to the detectors 12A, 12B. L, r₁, l₁, r₂ and l₂ are used inEquation 1 and Equation 2 to determine and store the coordinates of thecalibration marks 40 relative to detectors 12A, 12B. As discussed above,the control section relative to template data structure lists thecoordinates of the control sections 32 relative to the calibration marks40 on the template 18. Using traditional principles of geometry, thesecoordinates can be used in combination with the determined positions ofthe calibration marks 40 relative to the detectors, to determine thecoordinates for the control sections 32 relative to the detectors 12A,12B. The determined coordinates for the control sections are enteredinto the appropriate fields of the control section relative to detectorsdata structure.

Control is passed form process block 314 to process block 316 where theuser is prompted to position the stylus within a particular one of thecontrol sections 32. The prompt can take the form of the promptsdiscussed above with respect to process blocks 300 and 306. Control isthen passed to decision block 318 where a determination is made whetherthe position of the control sections relative to the detectors has beenproperly calculated. The determination can be made by calculating r andl for when the stylus is positioned within the perimeter of theparticular control section at process block 316. The determined r and lare used in Equations 1 and 2 to determine the position of the stylus 10relative to the detectors. The determined position is checked againstthe fields of the control section relative to detectors data structurewhich correspond the particular control section to determine whether thedetermined position falls within the particular control section. Whenthe determined position does not fall within the perimeter of theparticular control section, the determination is negative and control ispasses to process block 320. At process block 320 the user is providedwith an error message indicating an error during the calibration. Forexample, the error message can be a readable massage shown on themonitor or an indicator on the hardware unit can be activated toindicate the error condition. Control is returned from process block 320to process block 300.

When the determination at decision block 318 is positive, control ispassed to process block 322 where the dimensions of the writing area 38,W and H, are determined using one of several techniques. For instance,the user can be presented with a menu of typical writing area dimensionson the monitor 22 and the user can then use a user interface 24 toselect the appropriate writing area dimensions from the menu.Additionally, the user can use a user interface 24 to directly enter thedimensions of the writing area 38 into the processing unit. In anothertechnique where the first and second detectors 12A, 12B define thewriting area 38 and the template is positioned along a bottom edge ofthe writing area as illustrated in FIG. 11B, W can be set equal to thestored L. To determine H, the L, r₁ and r₂ determined as described aboveare used in Equations 1 and 2 to determine y₁ for the upper leftcalibration mark 40. The determined y₁ is then used in Equation 8 todetermine the writing area height, H, where C is a constant equal toabout the height of the template 18. Equations 7 and 8 are appropriatefor use with the transcription system illustrated in FIG. 11B but can beeasily adapted to the transcription system of FIG. 11C using theprinciples of triangulation. Once the writing area dimensions aredetermined by any of the above techniques, W and H are stored along withthe calculated L.

Control is passed from process block 322 to process block 324 where thewriting

    D=(H.sup.2 +W.sup.2).sup.1/2                               Equation 9

area diagonal 38 is determined via Equation 9 and stored. The timeoutlimit is then determined by dividing the length of the diagonal, D, bythe speed of sound. The timeout limit can be stored and/or loaded ontothe bus 206 where it can be accessed by the hardware controller 200.

Control is passed from process block 324 to process block 326. The ratioof W:H is then calculated and used to define a monitor image area 36 asillustrated in FIG. 1D. The monitor image area 36 is the position on themonitor 22 where the monitor image 34 will be formed. The ratio of thelength and width of the monitor image area 36, h:w, is equal to theratio of W:H. Control is then passed to the exit block 328.

As described above, certain embodiments of the transcription system donot require that the timeout limit be calculated such as when thetimeout limit is an administratively determined value. As a result, theneed to determine the timeout limit as described with respect to processblock 324 can be eliminated. Further, if the user does not intend to usethe control sections 32 on the template, the need to perform thefunctions in process blocks 314-421 can be eliminated. As a result, thelogic illustrated in FIG. 16A is intended to be illustrative and must beadjusted to accommodate different embodiments of the transcriptionsystem.

The calibration logic illustrated in FIG. 16A can be easily adapted foruse with other transcription systems. For instance, FIG. 16B illustratescalibration logic which is similar to the logic illustrated in FIG. 16A,however, process block 312 is moved to a position between the startblock 298 and the process block 300. Such calibration logic is suitablefor use with the systems of FIGS. 3B-3E.

In the systems of FIG. 3B-3E, the determination of the displacementbetween the detectors 12A, 12B can be independent of the template 18. Asa result, the logic for determining the displacement of the detectors,position of the control sections and dimensions of the writing area canbe independent of one another as illustrated by the brackets along theleft edge of FIG. 16B. As a result, in certain embodiments of thetranscription system, the user can determine the writing area dimensionsand detector displacement once but determine the detector displacementor the control section positions several times. As a result, a user canmove the template 18 to a new position on the writing surface anddetermine the new control section positions without having tore-determine the dimensions of the writing area or re-determine thedetector displacement.

The logic used to determine the displacement between the detectors 12A,12B in the systems of FIGS. 3B-3E can vary depending on which system isused. To determine the detector displacement with the system of FIG. 3C,the user is prompted to position the stylus 10 at the calibration mark40 on the first detector 12A and the time for the position signal 66 totravel from the first detector 12A to the second detector, t₂, isdetermined. The displacement between the detectors, L, is thendetermined by multiplying t₂ by the speed of sound. The dimension L canthen stored in the memory and control passed to process block 300 ofFIG. 16B.

To determine the displacement between the detectors in the system ofFIG. 3B, the processing unit 20 or hardware unit 14 can cause thereference signal receiver 56 and the position signal transceiver 70 onthe first detector 12A to become engaged. The processing unit 20 orhardware unit 14 can also cause a reference signal 64 to be transmittedfrom the second detector 12B. The reference signal 64 will be receivedat the reference signal receiver 56. In response, a position signal 66is transmitted from the position signal transceiver 70 and the time forthe position signal to travel between the first and second detectors, t₂is determined. The displacement between the detectors, L, is thendetermined by multiplying t₂ by the speed of sound. The dimension L canthen stored in the memory and control passed to process block 300 ofFIG. 16B.

As described above, certain embodiments of the transcription system donot require that the timeout limit be calculated. As a result, the needto perform the acts described with respect to process block 324 iseliminated. Further, the template is not required for calibration of thetranscription systems illustrated in FIGS. 3B and 3C and can beeliminated from the transcription system. As a result, the need toperform the determine control section position logic can also beeliminated. Consequently, it is conceivable to calibrate thetranscription systems illustrated in FIGS. 3B and 3C by performing onlythe acts described with respect to process blocks 312, 322, and 326 ofFIG. 16B.

It is not necessary to determine the displacement between the detectorsin the system of FIGS. 3D and 3E because the coupling member 74 can keepthe detectors 12A, 12B at a known displacement. As a result, thedetermine detector displacement logic can be eliminated from FIG. 16B.Additionally, when the timeout limit does not need to be calculated, theneed to perform the functions in process blocks 324 is eliminated.Further, the need to perform the determine control section positionlogic can be eliminated by removing the template 18 from the system. Asa result, it the transcription systems of FIGS. 3D and 3E can beoperated by performing only the acts described with respect to processblock 322 and 326.

The above calibration logic process flows are intended to be exemplaryand are not intended to limit the calibration techniques. For instance,many techniques for determining the writing area dimension as discussedwith respect to process block 322 are conceivable but not disclosed.Further, various combinations of the techniques disclosed with respectto process block 322 can also be used to determine the writing areadimensions.

The writing area 38 dimensions calculated during the above calibrationlogic can be stored in the memory 240 for subsequent uses. As a result,the system does not need to be calibrated each time the system is used.Each time the system is turned on, the user can be asked if the systemhas been positioned on a new writing surface 28. This inquiry can takethe form of a question on the monitor 22. When the user indicates thatthe system has not been positioned on a new writing surface 28, theprocessing unit 20 can work from the previously stored writing area 38dimensions. In other embodiments, the system can depend on the user tocalibrate the system when the system is positioned on a new writingsurface 28. In these embodiments, the system does not need to inquirewhether the system has been positioned on a new writing surface 28. Inother embodiments, the bus is monitored for a re-calibrate signal whichis placed on the bus by the hardware unit 14 when the first or seconddetector 12A, 12B has been removed from the writing surface 28. When are-calibrate signal is identified, the system must be re-calibrated oncethe system is re-installed on another writing surface 28. As a result,one of the above calibration logic process flows can be accessed whenthe re-calibrate signal is detected.

A process flow of the image creation logic is illustrated in FIG. 17.Control is passed from the start block 330 to decision block 334 where adetermination is made whether a stylus 10 or eraser 16 is being used inthe writing area 38. This determination can be made by monitoring thebus 206 for signals which are a result of output from a stylus 10 or aneraser 16. When the determination is negative, control is returned todecision block 334. When the determination is positive, control ispassed to process block 336 where the implement is identified bymonitoring the bus 206 for an identity signal. Control is then passed todecision block 338 where a determination is made whether the implementis an eraser 16. This determination is made by accessing the implementcharacteristic data structure 254. The implement identity signal iscompared with the implement identifier fields 256 until a match isfound. The corresponding implement field 258 is accessed to identifywhether the implement is a stylus 10 or an eraser 16. When thedetermination is positive, control is passed to subroutine 340 where theportion of the written image 44 which is erased is also erased from themonitor image 34. Control is then returned to decision block 334.

When the determination at decision block 338 is negative, control ispassed to decision block 342 where the first implement characteristicfield 260 and the second implement characteristic field 262corresponding to the identified stylus 10 are accessed. The first andsecond characteristics of the stylus 10 stored in the memory 240.Control is then passed to process block 344 where t₁ and t₂ arereceived. Control is then passed to process block 346 where t₁ and t₂are used in Equations 1 and 2 or 5 and 6, depending on the system beingused, to determine the stylus position, (x, y).

Control is passed from process block 346 to decision block 348. Atdecision block 348, a determination is made whether the stylus position,(x, y), is within any of the control sections 32 of the template 18. Thedetermination can be made by comparing the (x, y) with the coordinatessets listed in the control section relative to detectors data structure.When the determination is negative, control is passed from decisionblock 348 to process block 350 where the current stylus position, (x,y), is stored in the image data structure.

Control is passed from process block 350 to process block 352 where theimage data structure is filtered. For instance, in one filteringtechnique the position which was most recently stored in the image datastructure is compared with a moving average of positions stored beforethe most recently stored position. If the most recently entered positiondeviates from the moving average by more than a threshold deviation, themost recently entered position can be rejected by removing it from theimage data structure. The number of positions that should be included inthe moving average is preferably 2-100, more preferably 2-20 and mostpreferably 4-10. Another filtering technique includes determining thedistance of the most recently entered position from the previouslyentered position. When the distance is above some thresholddisplacement, the most recently entered position can be rejected byremoving it from the image data structure.

The filtering techniques described above can eliminate two sources oferror which can arise during use of the system. One source of errorderives from reflections of positions signals 66. During a positiondetection cycle, a position signal 66 can be reflected off an objectsuch as the user and then interfere with the next detection cycle.Another source of error can result from sudden variations in the system.For instance, the stylus 10 can suddenly be held at a different angle tothe writing surface 28. These sources of error can be eliminated byusing either of the filtering techniques disclosed above alone or incombination.

After filtering at process block 352, control is passed to process block354 where the image data structure is compressed. A single line can berepresented as only two positions. As a result, redundant positionsalong a line can be eliminated to reduce the number of positionsnecessary to create the monitor image 34. The compression can take theform of fitting the series of positions to a more compact form such as aspline.

Control is passed from process block 354 to process block 356 where themonitor image 34 is updated by plotting the most recent entry in theimage data structure on the monitor image 34 and creating a line betweenthe most recent entry in the image data structure and the previous entryin the image data structure. The line is created using the first andsecond implement characteristic of the stylus 10 which were determinedat decision block 342.

When the determination at decision block 348 is positive, control ispassed to process block 358. At process block 358, the function listedin the function field correlated with the control section 32 where thestylus 10 is positioned is performed. For instance, a new monitor imagearea 36 may be created on the monitor 22 so a new monitor image 34 canbe created or the previous monitor image 34 may be saved.

Control is passed from process block 356 and process block 358 todecision block 360. At decision block 360, a determination is madewhether the stylus 10 is still on the writing area 38. Thisdetermination can be made by monitoring the bus 206 for signals whichare a result of output from a stylus 10. When a predetermined period oftime passes without detecting such a signal, the determination isnegative, however, when such signals are received within thepre-determined period of time, the determination is positive. In anotherembodiment the determination can be made by monitoring the bus 206 for astylus removed signal loaded onto the bus 206 by the hardware controller200. When a stylus removed signal is detected, the determination isnegative and when a stylus removed signal is not detected, thedetermination is positive. In other embodiments, the determination canbe made using a combination of these two techniques. When thedetermination is positive, control is returned to process block 344.When the determination is negative, control is passed to process block362 where a break entry is placed in the image data structure. Controlis then returned to decision block 334.

The pressure placed on the stylus 10 can also be taken into accountduring the above process flow. As described above, the hardwarecontroller 200 can load onto the bus 206 a pressure signal whichindicates the pressure being placed on the stylus 10 by the user. Theprocessing unit 20 can receive the pressure signal and can include logicfor adjusting the width of strokes on the monitor 22 in response to theamount of pressure being placed on the stylus 10. For instance, when aline width is listed in a first or second implement characteristic field260, 262, the listed line width can be increased or decreased inproportion to the pressure being placed on the stylus 10. When linewidths are not listed in the first or second implement characteristicfields 260, 262, a standard line width can be used for each stylus 10.The standard line width can be adjusted according to the amount ofpressure being placed on the stylus 10.

FIG. 18 illustrates a process flow for an image erasing subroutine.Control is passed from the start block 366 to process block 368 wherethe time for the position signal 66 to pass from the stylus 10 to thefirst detector 12A and the second detector 12B, t₁ and t₂, is received.Control is then passed to process block 370 where t₁ and t₂ are used inEquations 1 and 2 or 5 and 6, depending on the system being used, todetermine the position of the eraser 16 (x, y). Control is then passedto process block 372 where positions listed on the image data structurewhich fall within the approximate eraser area 124 are identified. Theidentification can be made by using a relationship between theapproximate eraser area 124 and the position of the eraser 16. Forinstance, when the eraser 16 has a round shape, the approximate eraserarea 124 can be defined to cover all points within two inches of theeraser 16 position. All the positions listed in the image data structurewhich are within two inches of the eraser 16 position are thenidentified.

Control is passed from process block 372 to process block 374 where theidentified positions are removed from the image data structure. Controlis then passed to process block 376 where the monitor image 34 isupdated. The image update can take the form of removing from the monitorimage 34 the positions which are removed from the image data structureor re-creating the monitor image 34. Control is then passed to decisionblock 378 where a determination is made whether the eraser 16 is stillpositioned on the writing area 38. This determination can be made bymonitoring the bus 206 for signals which are a result of output from theeraser 16. When a pre-determined period of time passes without detectingsuch a signal, the determination is negative, however, when such signalsare received within the pre-determined period of time, the determinationis positive. In another embodiment the determination can be made bymonitoring the bus 206 for an stylus removed signal loaded onto the bus206 by the hardware controller 200. When an stylus removed signal isdetected, the determination is negative and when an eraser removedsignal is not detected, the determination is positive. In otherembodiments, the determination can be made using a combination of thesetwo techniques. When the determination is positive, control is returnedto process block 368. When the determination is negative, control ispassed to the return block 379 which returns control to the imagecreation logic.

The processing unit 20 can also include logic which allows the creationof the monitor image 34 to be played back to the user. This is possiblewhen the monitor image 34 is stored in an image data base as opposed tobeing stored as a bitmap. During the playback, the monitor image 34 iscreated by sequentially plotting and connecting the positions listed inthe image data structure on the monitor image area 36. The process ofplotting and connecting positions is performed at a rate which allowsthe user to observe the image creation. The playback of the monitorimage 34 allows the user to re-capture information which has been erasedor can extract information from the actual creation of the monitor image34. Further, the user can stop the playback at a particular point andedit the image at the point where it was stopped.

As discussed above, several different embodiments of the system canidentify the type of implement being used upon the writing area 38. Forinstance, whether the implement is an eraser 16 or a stylus 10 can beidentified as well as the type of the eraser 16 or stylus 10. Differenttypes of styluses 10 can write with different colors or line widths.Different types of erasers 16 can be erasers 16 have a footprint with adifferent size or shape. Different types of implements are generallylisted in the implement characteristic data structure 254 with differentimplement identifiers.

FIGS. 19A-19B illustrate one embodiment of implement identificationlogic. The implement identification logic operates via a series ofinquiries and responses between the implement and the hardwarecontroller 200 or the processing unit 20. The implement responds to theinquiries by responding or not responding to the inquiry signals with aposition signal 66. The implement identification process flow can beaccessed each time the implement produces an activation signal. As aresult, the implement is identified each time the implement contacts thewriting area 38.

The process flow illustrated in FIG. 19A can be included in the hardwarecontroller 200 of the hardware unit 14. The process flow can also beadapted for inclusion in the processing unit 20. Control is passed fromthe start block 380 to process block 382. At process block 382, aninquiry signal is transmitted to the implement. The inquiry signal canbe coded into a reference signal 64. The implement electronics 104includes logic which receives the reference signal 64 and recognizes theinquiry signal. The logic interprets the inquiry signal as inquiringwhether the implement is the same type of implement which was last usedon the writing area 38.

Control is passed from process block 382 to decision block 384 where adetermination is made whether the implement is a type which matches thetype requested by transmission of the inquiry signal. The determinationis based on whether the implement responds to the inquiry signal bytransmitting a position signal 66. When the implement responds with aposition signal 66, the determination is positive and when the implementdoes not respond, the determination is negative.

When the determination at decision block 384 is negative, control ispassed from decision block 384 to process block 386 where an inquirysignal is transmitted to the implement. The implement includes logicwhich recognizes the signal as inquiring whether the implement is aparticular type of implement. Control is then passed to decision block388 where a determination is made whether the implement is a type whichmatches the type requested by transmission of the inquiry signal. Thedetermination is based on whether the implement responds to the inquirysignal by transmitting a position signal 66. When the implement respondswith a position signal 66, the determination is negative and when theimplement does not respond, the determination is positive. When thedetermination is positive, control is passed to process block 390 wherethe t₁ and t₂ values for the transmitted position signal 66 are loadedonto the bus 206. Control is then returned to process block 386.

When the determination at decision block 384 is positive, control ispassed to process block 392 where the t₁ and t₂ values for thetransmitted position signal 66 are loaded onto the bus 206. Control ispassed from process block 392 to process block 394. Similarly, when thedetermination at decision block 388 is positive control is passed toprocess block 394. At process block 394, an identity signal is loadedonto the bus 206. The processing unit 20 can use the identity signal tomatch the implement being used with a implement listed in an implementidentifier field 256 of the implement characteristic data structure 254.As a result, the processing unit 20 can identify the implement beingused on the writing area 38. Control is passed from process block 394 toexit block 396.

FIG. 19B illustrates a process flow which is included in the implementelectronics 104 and which is complementary to the process flowillustrated in FIG. 19A. Control is passed from start block 398 toprocess block 400 where an inquiry signal is received. The inquirysignal can be coded in a reference signal 64 from a reference signaltransmitter 62. The implement electronics 104 can include logic foridentifying the inquiry signal. The logic also interprets the inquiry asan inquiry whether the implement is a particular type of implement.Control is passed from process block 400 to decision block 402 where adetermination is made whether the implement is the type of implementinquired about in the inquiry signal. When the determination is negativecontrol is returned to decision block 404.

At decision block 404 a determination is made whether the receivedinquiry signal is the first inquiry signal the implement has receivedduring the period of time the implement has been continuously in contactwith the writing area 38. When the determination is negative, control ispassed to process block 406 where the implement transmits a positionsignal 66. Control is then returned to process block 400. Similarly,when the determination at decision block 404 is positive, control ispassed to process block 400.

When the determination at decision block 402 is positive, control ispassed to decision block 408. At decision block 408 a determination ismade whether the received inquiry signal is the first inquiry signal theimplement has received during the period of time the implement has beencontinuously in contact with the writing area 38. When the determinationis positive, control is passed to process block 410 where the implementtransmits a position signal 66. Control is passed from process block 410to exit block 412. Similarly, when the determination at decision block408 is negative, control is passed to exit block 412.

The above implement identification logic can include additional logicfor prioritizing transmission of the inquiry signals. For instance, theinquiry signals can be transmitted so the inquiries pertaining to themost recently used implement types are transmitted at the beginning of aseries of inquiries. Further, inquiry signals relating to the leastrecently used or unused implement types can be transmitted later in theinquiry sequence. For instance, if a red stylus 10 is used first, aneraser 16 second and a black stylus 10 third, the next series of inquirysignals may inquire whether the stylus 10 is a black stylus 10 first, aneraser 16 second and a red stylus 10 third. Because the most recentlyused implements are most likely to be used for a new stroke, theprioritization scheme minimizes the number of inquiries which must bemade to identify the implement. Other priority logic may also beutilized, e.g., always putting the eraser second after the last penused.

The above implement identification logic also minimizes the number ofposition data points which are lost because the implement does nottransit a position signal 66. The first time a implement receives aninquiry signal, the implement does not respond with a position signal 66if the implement does not match the implement sought by the inquirysignal. However, each subsequent time the implement receives an inquirysignal, the implement transmits a position signal 66 when the implementdoes not match the implement sought by the inquiry but does not transmita position signal 66 when the implement does match the implement soughtby the inquiry signal. As a result, a large number of non-matchinginquiry signals can be transmitted and a maximum of only two data pointswill be lost in the process of identifying the implement.

The transcription system can also include calibration logic forcalibrating the position of a background image relative to a writingsurface. The background image may be positioned adjacent the writingsurface (e.g., positioned on or behind the writing surface), may formthe writing surface, or may be projected onto the writing surface. FIG.20 illustrates an example process flow for background image calibrationlogic. The start block 414 is accessed when the processing unit 20 orthe hardware unit 14 is notified that a background image 50 will be usedwith the transcription system. The user can notify the system that abackground image 50 is being used by positioning the stylus tip in aparticular one of the control sections 32 on the template 18 or byentering information to the processing unit 20 via the user interface24. Alternatively, the hardware unit 14 can include a control switch 182which can be activated to indicate that a background image 50 is beingused.

Control is passed from start block 414 to process block 416 where theuser identifies the background image 50 which will be used incombination with the writing surface 28. As described above, thecomposite images 52 can be created internally or externally and thenstored in the processing unit 20 as an Image file. Upon saving compositeimages 52 as Image files, the user can provide each Image file withdifferent identifying characteristics such as different names and/ordifferent locations (i.e. different directories) within the processingunit 20. The different identifying characteristics can be created usingtraditional file management programs such as WINDOWS 95, PC DOCS andIMANAGE. At process block 416, the user can be presented with a menulisting each of the composite images 52 which has been stored as anImage file or listing each of the Image files in the current directory.The user can scroll through the list to identify the Image file ofinterest. Once the proper Image file has been identified, the user canselect the proper Image file. One suitable method for selecting theproper Image file is using a user interface 24 which controls a cursor,such as a mouse, and double clicking on the identified Image file.Alternatively, the user can select the identified Image file byhighlighting the identified Image file and then clicking on a box whichmay include a word such as "OK".

Control is passed from process block 416 to process block 418 where theuser is directed to position the background image 50 upon the writingsurface 28. The method for directing the user can be similar to themethods of directing the user to position the stylus in contact with thecalibration marks 40. Once the background image 50 is positionedrelative to the writing surface 28, the user can notify the processingunit 20 using techniques which are similar to the techniques used tonotify the processing unit 20 that an background image 50 will be used.Control is passed from process block 418 to process block 420 where theuser is prompted to contact the stylus tip with a calibration mark 40present on the background image 50. Prompting the user to contact thestylus with the calibration marks 40 on the background image 50 can besimilar to the prompts discussed with respect to FIG. 1B. For instance,the monitor image 34 can include an image of the stylus contacting thecalibration point on the composite image 52. Control is passed toprocess block 422 where t₁ and t₂ are determined and used in Equations1-4 to determine the position of the first calibration mark relative tothe detectors, (x₁, y₁). Control is passed to process block 424 wherethe user is directed to contact the stylus tip with a second calibrationmark 40 present on the background image 50. Control is passed to processblock 426 where t₁ and t₂ are determined and used in Equations 1-4 todetermine the position of the second calibration mark 40 relative to thedetectors, (x₂, y₂).

Control is passed from process block 426 to process block 428 where thecomposite image 52 is created upon the monitor 22. The composite image52 is scaled so the first calibration mark 40 on the composite image 52is positioned on the monitor image at (x₁, y₁) and the secondcalibration mark 40 on the composite image 52 is positioned on themonitor image 34 at (x₂, y₂). Control is passed from process block 428to exit block 430 which can be a return to the start block of the imagecreation logic.

The logic illustrated in FIG. 20 is intended to be illustrative and notintended to be limiting. For instance, as discussed above, thebackground image 50 can include more than two calibration marks 40 toincrease the quality of correlation between the position of thebackground image 50 on the writing surface 28 and the position of thebackground image 50 on the image area 36. Increasing the number ofcalibration marks 40 can increase the number of acts required to performout the background image calibration.

Additional permutations of the background image calibration logic arealso contemplated. For instance, the select background image actillustrated in process block 416 can be replaced with a selectbackground image sequence act. As discussed above a background imagesequence can be a sequence of composite images 52 which are establishedby the user. The user can then advance through the background imagesequence to the desired composite image 52. Suitable means for advancingthrough the overlay image sequence include, but are not limited to,positioning the stylus tip in a particular one of the control sections32 on the template 18, entering information via a user interface 24 oractivating a control switch 182 on the hardware unit 14. Similarmechanisms can be used to reverse through the background image sequence.Further, when a background image is projected onto the writing surface28, the projector can be coupled with the processing unit 20 and thebackground images can be advanced or reversed with the composite images52.

The transcription system disclosed above is described with a hardwareunit 14 which is independent of the processing unit 20. It is noted,however, that the hardware unit 14 and the processing unit 20 can beintegrated in a single unit. For instance, the hardware controller 200,the processor 238, the volatile memory 242 and the storage unit 244 canbe contained in a single hardware unit 14. The hardware controller 200and the processor can be integrated into a single processing element.Further, the storage unit 244 and/or the volatile memory can beincorporated into a single memory device. Integrating the hardware unit14 and the processing unit 20 permits the functions which arecharacterized above as performed by the processing unit 20 to performedby the hardware unit 14. For instance, the image data structure can becreated and stored within the hardware unit 14 as the written image 34is created. As a result, the monitor image 34 can be stored withoutusing a processing unit 20 and without being displayed on a monitor 22.After the image data structure has been stored in the hardware unit 14,the hardware unit 14 can be coupled with a monitor 22, a printer, anetwork and/or a processing unit 20. These connections respectivelyallow the image stored in the hardware unit 14 to be displayed, printed,forwarded to another location or downloaded to another storage medium.

Additionally, while the hardware unit 14 is illustrated above as ahousing for a plurality of electronics, it is noted that the hardwareunit 14 can refer to any collection of electronics which perform thefunction(s) of the electronics within the illustrated hardware unit. Asa result, the hardware unit can actually be distributed among differentlocations throughout a transcription system. Further, the hardware unitcan be included in several different housings and/or several differenttypes of housings.

Further, the first and second detectors 12A, 12B are disclosed as beingremovable from a writing surface 28. However, the first and seconddetectors 12A, 12B can also be integrated with the writing surface 28.In embodiments where the first and second detector 12A, 12B areintegrated with the writing surface 28, the calibration acts describedabove can be eliminated since the writing area 38 dimensions will beconstants which can be administratively entered into the system beforethe system is sold to the end consumer. Additionally, although thesystem is disclosed with first and second detectors 12A, 12B, additionaldetectors may be added to the system to facilitate the calibrationprocess, to provide additional resolution to the monitor image 34 or thefurther refine the monitor image 34.

EXAMPLE

The following is an example of a transcription system according to thepresent invention, its contents and operation. FIG. 21 illustrates atranscription system kit. As illustrated, the kit includes a detectorassembly 512, a set of styli 514, a set of whiteboard markers 516, aneraser 518, and a template 520.

FIG. 22 illustrates a stylus 514 which has been taken apart so that amarker 516 can be placed within the stylus 514. As illustrated, thestylus 514 includes a stylus body 522 which houses a AAA battery 524 andan ultrasound transmitter 526 adjacent a writing end 528 of the stylus.The stylus 514 also includes a side cover 530 which is sufficientlyclear or translucent such that one can see the marker 516 through theside cover 530. The stylus 514 also includes a cap 532 which issufficiently clear or translucent such that one can see a writing tip ofthe marker 516 through the cap 532.

FIGS. 23A and 23B illustrate a stylus 514 containing a marker 516. FIG.23A illustrates a side view of the stylus 514 where the stylus cover 530is in full view. As illustrated, the writing tip 538 of the marker isuncapped and the cap 532 is attached to an end 536 of the stylus 514opposite the writing end 528. As can be seen in FIG. 23A, the marker 516is in full view within the stylus 514 through the stylus cover 530.

FIG. 23B illustrates a side view of the stylus 514 where the styluscover 530 is on top and the stylus body 522 is below. As illustrated,the writing tip 538 of the marker 516 is capped by the cap 532. The cap532 preferably seals the writing tip to prevent the marker 516 fromdrying out. As can be seen, the cap 532 is sufficiently clear ortranslucent such that one can see the writing tip 538 of the markerthrough the cap 532. This allows the user to rapidly identify the colorof the marker.

FIG. 24A illustrates the detector assembly 512 unfolded (folded in FIG.21). The detector assembly includes two signal receivers 534A, 534B, twosuction cup assemblies with attachment levers 536A, 536B and a series ofuser inputs 538A-E.

FIG. 24B illustrates the detector assembly 512 attached to a whiteboardsurface via the suction cup assemblies.

FIG. 24C illustrates the user inputs 538A-E on the detector assembly512. The new board input causes the transcription system software tosave what has been inputted on the whiteboard and to open a new blankfile for capturing transcription information. The bookmark board inputcauses the transcription system software to save what has been inputtedon the whiteboard while retaining the currently displayed information.The print board input causes what is currently being electronicallydisplayed by the transcription system to be printed. The maximize boardinput causes the transcription system application window to be maximizedand make the transcription system application the active window. Thelocate template input causes the transcription system software toactivate the run a protocol to determine the position of the template onthe whiteboard.

FIG. 25 illustrates how the detector assembly 512 can be attached to aprocessor via a connection cable 540, in this instance a processor of apersonal computer. As illustrated, the detector assembly 512 includes adata port 542 to which a detector assembly connector 544 on theconnection cable 540 can be attached. The connection cable 540 alsoincludes a serial connector 546 for connecting the connection cable 540to one of the serial ports 549 of the personal computer. As illustrated,the connection cable 540 includes a keyboard passthrough 547. As aresult, it is possible to connect the keyboard passthrough 547 to thekeyboard port 548 of the personal computer and connect the keyboard 551to the keyboard passthrough 547. When the detector assembly 512 isconnected to the personal computer, a light 553 on the detector assembly512 goes on.

FIG. 26A illustrates a user interface 550 for the transcription system.As illustrated, the user interface 550 illustrates putting the detectorassembly 512 in the upper left hand corner of the writing surface. FIG.26B illustrates a whiteboard 552 with a detector assembly 512 attachedand a smiley face 554 written using a transcription system stylus. FIG.26B also illustrates the user interface 550 which shows anelectronically transcribed image 556 of the smiley face 554.

FIG. 27A illustrates the user interface 550 in greater detail and someof the functions which the user interface 550 performs. For example, theuser interface 550 includes a board display area 558 where captured datais displayed. The user interface 550 also includes various toolbars.Three of the most common toolbars are illustrated: The main toolbar 560includes various common Windows functions including open, delete, saveand print. The display toolbar 562 allows the user to change the way thedata is being viewed (zoom, multiple board view, etc.). The pen toolbar564 allows the user to alter the user to input or edit data with virtualpens and erasers. As with most Windows applications, the menu bar 566allows the user to access program features. Most of the functionalityprovided through the menu bar can be more readily accessed through thetoolbars. The navigation toolbar 570 allows the user to alter variousconfiguration options including board size and pen color. The playbacktoolbar 571 allows the user to take a recorded transcription session andto playback the transcription session. As illustrated, user can go tothe beginning, move back, play, stop, move forward, or go to the end.The playback toolbar 571 also includes a sliding lever 573 which allowsthe user to move to any portion of the recorded transcription session bymoving the sliding lever 573.

FIG. 27B illustrates the display toolbar 562 and its operation. Asillustrated, the display toolbar 562 includes a button for a multipleboard view, a single board view, and a full screen view. Alsoillustrated is a single board and multiple board display. The displaytoolbar 562 also includes a button for notes. Pressing the notes buttonbrings up a notes window which may contain additional information aboutthe image being displayed.

FIG. 27C illustrates the navigation toolbar 570 and its operation. Asillustrated, the navigation toolbar 570 includes buttons for next board,previous board, zoom full, zoom in, and zoom out. FIG. 27C alsoillustrates a screen 572 where a box 574 has been drawn around a portion576 of an image 578 and a screen 580 where the portion 576 of the image578 has been enlarged to fit the screen 576.

FIG. 27D illustrates the template 520 in greater detail. As illustrated,the template includes a series of user inputs, many of which also appearon the detector assembly 512. The new board input causes thetranscription system software to save what has been inputted on thewhiteboard and to open a new blank file for capturing transcriptioninformation. The bookmark board input causes the transcription systemsoftware to save what has been inputted on the whiteboard whileretaining the currently displayed information. The print board inputcauses the transcription system software to print what is currentlybeing electronically displayed by the transcription system. The maximizeboard input causes the transcription system software to maximize thetranscription system application and make the transcription systemapplication the active window.

The template 520 also includes first and second calibration marks 584,586 which the transcription system uses to determine the position of thetemplate 520 relative to the detector assembly 512 a writing surface, asdiscussed in FIGS. 27E(1)-27E(4).

The template 520 also includes a calculator which allows the user tooperate the transcription system and perform calculations at the writingsurface using a stylus.

The template 520 also includes a mouse region 592 which serves as avirtual touch pad for the user. The user can move a stylus within themouse region 592 and cause a cursor associated with the system to move.Thus, by moving the stylus within the mouse region 592, the stylus canserve as a mouse for the system.

The template 520 also includes a graffiti region 594 which can recognizehandwritten signals, such as handwritting graffiti used with the PALMPILOT. The system includes logic for utilizing the movement of thestylus within the graffiti region 594 and translating that movement intohandwritten signals.

FIGS. 27E(1)-27E(4) illustrate the template 520 and the detectorassembly 512 on a writing surface 582 [FIG. 27E(1)] and a sequence ofimages [FIGS. 27E(2-4)] displayed on a user interface to allow thetranscription to determine the position of the template 520 relative tothe detector assembly 512 on the writing surface 582. In order toinitiate this sequence, the user may press the locate template input onthe detector assembly 512 [FIG. 54C].

As illustrated in FIG. 27E(2), the user is directed to contact a firstcalibration mark 584 on the template 520 with the stylus. Once the usercontacts the first calibration mark 584 with the stylus, the userinterface changes [FIG. 27E(3)] and directs the user to contact a secondcalibration mark 586 on the template 520. Once the user contacts thesecond calibration mark 586 with the stylus, the user interface changes[FIG. 27E(4)] and directs the user to contact the checkmark box 588 onthe template 520. After performing this sequence, the transcriptionsystem knows the position of the template 520 relative to the detectorassembly 512 and the user can employ the template 520.

FIGS. 28A and 28B illustrate two windows which may be accessed by thenavigation toolbar 570. FIG. 28A illustrates a window which allows theuser to configure the writing surface. FIG. 28B illustrates a windowwhich allows the user to configure the stylus.

Once data has been introduced into the transcription system, the datacan be exchanged with various application in many different ways. Forexample, a Windows clipboard can be used to export images from thetranscription system into other applications. Alternatively, images canbe identified, dragged and dropped into other applications.Alternatively, transcription system files can be saved in a variety ofdifferent formats and then opened by other applications.

The transcription system can be used locally or networked with othercomputers which include the transcription system operating system. Forexample, the transcription system operating system can support networkconferencing through Microsoft's NETMEETING™ software.

While the present invention is disclosed by reference to the preferredembodiments and examples detailed above, it is to be understood thatthese examples are intended in an illustrative rather than limitingsense, as it is contemplated that modifications and combinations willreadily occur to those skilled in the art, which modifications andcombinations will be within the spirit of the invention and the scope ofthe appended claims.

What is claimed is:
 1. A stylus for use in a transcription system whichincludes a plurality of signal receivers for positioning adjacent awriting surface and for receiving a position signal transmitted from thestylus when the stylus is positioned adjacent the writing surface, thesignal receivers producing timing signals in response to receiving theposition signal from the stylus, the transcription system using thetiming signals to determine a position of the stylus adjacent thewriting surface, the stylus comprising:a stylus housing defining avolume for housing a writing element, an opening on a distal end of thestylus housing through which a portion of the writing element extendsfor writing on a writing surface, and a door on a side of the stylushousing which can be opened or removed and through which a writingelement can be introduced into and removed from the stylus housing; andthe position signal transmitter for transmitting the position signal. 2.A stylus according to claim 1 wherein the position signal transmittertransmits an ultrasound signal.
 3. A stylus according to claim 1 whereinthe position signal transmitter transmits a radar signal.
 4. A stylusaccording to claim 1 wherein the position signal transmitter transmits amicro-impulse radar signal.
 5. A stylus according to claim 1 wherein thestylus further includes a reference signal transmitter for transmittinga reference signal when the writing element is sensed by the contactswitch to be in contact with the writing surface.
 6. A stylus accordingto claim 5 wherein the reference signal transmitter transmits aninfra-red signal.
 7. A stylus according to claim 1 wherein the stylusfurther includes a contact switch for sensing when the writing elementis contacted with a writing surface, the position signal transmittertransmitting the position signal when the writing element is sensed bythe contact switch to be in contact with the writing surface.
 8. Astylus according to claim 7 wherein the stylus further includes areference signal transmitter which transmits a reference signal when thewriting element is sensed by the contact switch to be in contact withthe writing surface.